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ABSTRACT 

This study examined some effects of Minicourse 5 --a 
remedial mathematics tutoring package — on tutoring skills of teachers 
of educable roentc-lly retarded children and on subsequent mathematics 
performance lewd a of their students. The design of the study 
included an experimental group of teachers who participated in 
Minicourse 5 along with corresponding experimental and control groups 
of students who were administered pre- and post-experiment tests of 
mathematics performance. Videotaped samples of tutoring sessions were 
analyzed using the t-test for correlated means and the Wilcoxon 
matched- pairs, signed-ranks test to determine changes in teacher 
tutoring behavior and the degree of retention of this behavior. 
Resulting effects of teachers' participation in Minicourse 5 on 
students were assessed via achievement in mathematics. Statistically 
significant differences in mathematics performance occurred in favor 
of students in the experimental group over students in the control 
group. Conclusions arrived at from the results were that Minicourse 5 
improves mathematics tutoring performance of special education 
teachers in selected skills and that these skills are pertinent to 
the teachers' instructional content. An extensive bibliography and 
appendixes of Minicourse material are included. (Author/MJM) 
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PROJECT ABSTRACT 



There is often a disparity between the amount of information 
presented in teacher in-service training programs and the amount of 
this information which is actually applied in the classroom. Mini- 
courses show promise as a contribution to the solution of this problem. 
To date, minicourses have been validated only to the extent that mod- 
ifications in teacher behavior occurred. A search of the literature did 
not yield evidence which assessed a subsequent modification in student 
performance as a result of the teacher participation in minicourse in- 
struction. There was no evidence to indicate specifically that mini- 
courses have utility for special education teachers. 

This study examined some effects of Minicourse 5, a re- 
medial mathematics tutoring package, on tutoring skills of teachers 
of educable mentally retarded children and on subsequent mathematics 
performance levels of their students. The design of the study includ- 
ed an experimental group of teachers who participated in Minicourse 
5 along with corresponding experimental and control groups of students 
who were administered pre- and post-experiment tests of mathematics 
performance. 

Videotaped samples of tutoring sessions were analyzed using 
the t- test for correlated means and the Wilcoxon matched-pairs, 
signed-ranks test to determine changes in teacher tutoring behavior 
and the degree of retention of this behavior. Significant increases in 
teachers' use of diagnostic questions, specific verbal praise, and 
manipulative items occured. Teachers did not significantly increase 
their use of prompting questions, general verbal praise, o v her se- 
lected skills, demonstration techniques, nor evaluation and practice 
techniques. 

Resulting effects of teachers' participation in Minicourse 5 
on students was assessed via achievement in mathematics. Statisti- 
cally significant differences in mathematics performance occured in 
favor of students in the experimental group over students in the con- 
trol group. 

Conclusions arrived at from the results were that Minicourse 
5 improves mathematics tutoring performance of special education 
teachers in selected skills and that these skills are pertinent to 
the teachers' instructional content. The validity of Minicourse 5 is 
supported for special education. 
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INTRODUCTION 



Extension courses, university summer sessions, and meet- 
ings organized by professional organizations have been the primary 
sources of educational updating for special education teachers. There 
is a lack of data which establish a relationship between inform - 
mation provided by these sources and improvement in instructional 
skills of teachers (Allen & Ryan, 1969). In recent years, an in-service 
approach in the form of short term training workshops which specialize 
in specific instructional skills has come into prominence. The work- 
shops conducted by the Research and Training Center of the University 
of Oregon (1967, 1968) were examples of this approach to teacher train- 
ing. Many in-service training workshops employed as their major 
training techniques traditional procedures of readings, lectures, and 
discussions. There were few provisions for practice by participants 
during the workshops. In recognition of this void, a different model 
of teacher in-service training has been devised (Borg, Kelley, Langer, 
and Gall, 1970). 



The Far West Laboratory for Educational Research and Dev- 
elopment has developed a series of in-service instruction packages 
called "minicourses" which include provisions for ongoing partici- 
pant practice of the particular skills or techniques which are present- 
ed in the courses (Borg, Kallanbach, Kelley, and Langer, 1968). The 
minicourse provides teachers with a means of evaluating their use of 
these skills in the classroom. Basic components of the minicourse 
packages include the following: (1) presentation of a specific teaching 
skill through instructions on videotapes or 16 mm films, a handbook of 
instructions, and a videotaped model; (2) preparation and presentation 
by the participant of a microteach lesson (while being videotaped) fol- 
lowed by a critique of the lesson by the participant and a colleague. 

(3) revision and presentation of a revised lesson (while being video- 
taped), followed by a re-critique. The microteach component of the 
minicourse is based upon the model develooed in the Stanford "micro- 
teach” approach (Allen & Fortune, 1966). 

Empirical evidence has shown the minicourse to be 
successful in changing teacher behavior in the majority of tested 
situations (Borg, et al, 1968, Langer, 1969). Effects of minicourses 
on student outcomes have not been pursued during the initial field tests. 
In addition, the majority of field tests to date used teachers in conven- 
tionaJ public school settings. Little information is available to support 
the utility of minicourses for in-service instruction with teachers of 
handicapped children. 
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The degree of applicability of the minicourse approach to 
special education needs study. The in-service training pro- 
vided in the past for special education teachers has not differed 
in approach from that provided for teachers in regular classes. 
Although minicourses are designed to be used primarily with class- 
room teachers of children who do not exhibit specific educational 
deficiencies, some evidence exists to support their use with teach- 
ers of "high risk” pupils (Borg, et al, 1970). Teachers of educable 
mentally retarded (EMR) children appear to be subjects for initial 
investigations in this area since these teachers comprise a large 
percentage of those who work with handicapped children. 

There are a number of minicourses either completed or 
nearing completion which may have potential utility for teachers 
of handicapped children (Appendix A). Minicourse 5, entitled 
"Individualizing Instruction in Mathematics" was considered to be 
an appropriate minicourse for investigation primarily because it 
is ", . .focused on remedial work. . . " and because it deals with a 
critical skill, that of mathematics (Borg, et al, 1970, p. 141). 

The package provides instruction in remedial mathematics instruc- 
tion techniques, and is geared toward an individualized tutoring 
setting. Number operations and verbal problems are the main 
emphases of Minicourse 5 (Appendix B). This minicourse has 
not been the subject of extensive research outside the field tests 
conducted by the Far West Laboratory. No research has been 
conducted with M inicourse 5 using teachers of educable mentally 
retarded students or assessing effects on student performance. 
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REVIEW OF RELATED LITERATURE 

I. Literature on Microteaching 



As an in-service training package, the minicourse is the 
result of extensive basic and applied research in teacher education 
(Borg, et al, 1970). One of the key components of the minicourse, 
microteaching, has received considerable attention in recent 
years. 



The Stanford Microteaching procedure is described as 
containing five steps: 

1. the teacher prepares a lesson plan incorporating a 
specific teaching skill (10 to 15 minutes). 

2. the lesson is taught to a small group of students 
(four to five). 

3. the teacher and a supervisor or colleague critique a 
recording of the lesson. 

4. the lesson is revised and re-taught. 

5 ‘ iQRo\ e "* teaCh lesson is a S ain critiqued (Allen and Ryan. 



u • A S?lP le definition of microteaching has been presented 
by Meier (1968, p. 146) as ”... a scaled down sample of teaching 
with micro referring to ... a reduction in lesson and class size. 

1 1 adds the scientific connotation of precision. " Allen and Ryan 
P“t that practice is the guiding principle in microteaching 

pupiMl?69 C T a 47) ing iS ” real " teachin S whether with peers or 

The origins of microteaching are primarily within the last 
decade. Concentration on a specific skill, in addition to other 
aspects of microteaching, may have been influenced by the work 
of Suchman (1960, 1961) in the single concept approach within 

M OQfl ry i^? in ^ nd by behavioral Psychologists such as Skinner 
( , 1954). The closest facsimile to the present day micro- 

teach model was initiated in the summer of 1963 in a clinic for 
beginning intern teachers at Stanford University (Allen & Ryan, 
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1969). The single skill lesson, short term teaching, critiquing 
and reteach components were combined into a sequence during 
this clinic. Following the success of this clinic, microteaching 
was adopted as part of the regular teacher education program for 
several years. Aubertine (1964) conducted an experiment which 
contributed toward the inclusion of a basic component in micro- 
teaching, the selection of specific skills as content of instruction. 
The skill employed in Aubertine' s study was set induction; the 
preparation of students for a lesson before beginning a lesson. 

Allen and Ryan (1969) consider Aubertine' s work to have provided 
direction in the development of a protocol for selecting critical 
teaching skills. 

Several advantages of microteaching over more conventional 
teacher training techniques have been pointed out. Allen and 
Ryan (1969) have listed five advantages as follows: 

1. Microteaching is real teaching— although the teaching 
situation is a constructed one--a practice situation, 
bonafide teaching does take place. 

2. Microteaching lessens the complexities of normal 
classroom teaching. Class size, scope of content, 
and time are all reduced. 

3. Microteaching focuses on training for the accomplish- 
ment of specific tasks. These tasks may be the 
practice of instructional skills, or the practice of 
techniques of teaching. 

4. Microteaching allows for the increased control of 
practice. In the practice setting of microteaching, 
the rituals of time, students methods of feedback, 
and supervision and many other factors can be 
manipulated. 

5. Microteaching greatly expands the normal knowledge — 
of — results or feedback dimension in teaching. 
Immediately after teaching a brief micro-lesson, 

the trainee engages in a critique of his performance 
(p. 2). 

Several diverse yet pertinent merits of microteaching are 
apparent. Meier (1968) suggests that microteaching is useful as 
a remedial procedure to help the in-service teacher overcome 
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specifically designated weaknesses to which more conventional 
in-service training programs may not be relevant. As a vehicle 
for individualization of instruction in teacher education, micro- 
teaching, by design has not been excelled (Allen & Ryan, 1969). 

In summarizing the usefulness of microtraining, which 
encompasses micrcteaching, Meier (1968, p. 154) stated "micro- 
training places at the disposal of the professional, a technique that 
will help him to re-appraise his own behavior sensitivity, receive 
the objective appraisal of others, and exercise the prerogative to 
change whatever he wishes. 



Stanford University Studies 

Extensive and varied reports of research are available on 
the applicability of microteaching to teacher education. Probably 
the most intensive research on the subject has been conducted by 
the "Stanford group" (Borg, et al, 1970). 

Fortune, Cooper and Allen (1967) described the 1965 sum- 
mer microteaching clinic at Stanford University in which two 
experiments were carried out. Methods of training teachers in 
task direction skills using microteaching and specific behaviors 
in student appraisal of teaching were studied. General conclusions 
of the experiments were that significant behavior changes were 
produced in teacher education candidates and that the majority of 
the candidates appraised the experience favorably. The findings 
of these experiments substantiate the results of previous research 
(Aubertine, 1964). 

In another experiment conducted at Stanford University, 

Allen and Fortune (1964) compared relative teacher effectiveness 
of teacher education candidates who received microteaching expe- 
riences to those who did not receive the experiences but served as 
teacher aids. The group who received microteaching experiences 
obtained significantly higher ratings on selected measures. The 
microteaching approach was shown to be much less time consuming 
than the teacher aid experience. 

Aubertine (1967) described the research involved in develop- 
ing a twelve month per year microteaching clinic. Teachers in the 
field were trained in techniques of microteaching in order to super- 
vise student interns who had received microteaching experiences in 
the clinic. The program successfully achieved it’s objectives and 
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developed a pool of intern supervisors who were versed in the 
techniques of microteaching. 



Applications of Microteaching 

In addition to results of the research conducted by the 
Stanford group, a number of supportive investigations such as 
those of Brown (1968), Leonard (1969), and Hoerner (1968), con- 
ducted in other areas of the country have been reported. 

Brown (1968) compared the effects of microteaching to the 
SKIT (Skilled Teaching) approach in a teacher education program 
for business teaching interns. The effects of variables of audience 
composition, such as group size and presence of peers, and the 
transferability of acquired skills to criterion situations were also 
tested. Two experimental groups and a control group of interns 
were pre and post tested on the level of performance for six teach- 
ing skills. The skills were applied in the teaching of high school 
students, peers, and beginning education students. Results indicat- 
ed no difference between the three groups on audience composition 
factors. Significant differences in favor of the microteaching group 
were reported on five of the six teaching skills. 

Leonard (1969) examined microteaching used in conjunc- 
tion with the Flanders Interaction Analysis System (FIAS) in the 
training of elementary school interns. Two variables, the level 
of spontaneous indirect influence and the degree to which interns 
categorized their own classroom behaviors were measured. Fol- 
lowing microteaching sessions in use of the FIAS, interns in two 
groups applied the FIAS on their own classroom behavior and on 
the classroom behaviors of others. A third group served as 
control. The experimenter reported that findings do not support 
a complementary relationship between the Flanders Interaction 
Analysis System and microteaching. 

Hoerner (1968) used a microteaching approach in a pre- 
service workshop for trade and industrial education students. He 
found no differences in comparing videotaped feedback to no video- 
taped feedback, two, ten minute to four, five minute lessons, and 
the use of peers to high school students. The extremely short 
duration of the experiment may have nullified any appreciable ef- 
fects. 
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In another study which examined the utility of microteaching 
in the training of prospective elementary school teachers, Davis 
(1969) hypothesized that a greater competency in selected technical 
skills of teaching would result following microteaching sessions. 

Set induction or introductory teaching skills were the skills select- 
ed for the study. An experimental group received microteaching 
experiences previous to beginning their student teaching experiences. 
A control group of student teachers taught without receiving micro- 
teaching experiences. Videotaped samples of the student teachers 
were collected during their student teaching experiences. Davis re- 
ported that a slight difference on the selected skills in favor of the 
control group resulted. 

One study was reported which attempted to examine effects 
of microteaching on students’ behavior as well as teachers’ behavior. 
Robinson (1971) conducted a year long in-service training program 
with sixteen junior high school social studies teachers in which he 
combined microteaching with training in interaction analysis tech- 
niques. He found highly significant differences in use of direct 
teaching techniques favoring teachers who received the in-service 
training program over teachers who did not receive the program. 
Hypothesized differences did not occur between experimental and 
control group students on measures of achievement, attitude, nor 
ability to do critical thinking. 

The effects of videotaping and audiences on students’ partic- 
ipation in microteaching is often a question of concern. In an at- 
tempt to gain information concerning this question, Waldrop (1971) 
compared the coping behavior of children who were used as micro- 
teaching students under four differing settings: 1. exposed video- 
tape equipment, technicians, and audience, 2. concealed videotape 
equipment and technicians with no audience, 3. concealed video- 
tape equipment and technicians with an audience, 4. exposed video- 
tape equipment and technicians with no audience. She reported that 
students in settings 2 and 3 performed better on an index of coping 
behavior than did students in the other settings. She concluded that 
videotape equipment in microteaching has a distracting effect on 
pupils’ coping behavior during four microteach sessions. 

The number of microteach sessions, the size of the micro- 
teach groups, and the value of using peers as students for micro- 
teaching were the subjects of an investigation conducted by Staley 
(1971). Via comparisons of six groups of preservice teachers under 
varied conditions of microteaching, he found no difference in student 
teacher performance as a result of differences in the number of 
microteach sessions or the size of the microteach class. Nor did 
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he find differences between microteach participants who used peers 
as students compared to those who used elementary school children 
as students. 

In addition to summer training programs, microteaching 
has been used successfully in large scale on-going teacher educa- 
tion programs such as that which is conducted at the University of 
Texas (Davis & Smoot, 1970). Students participating in a teach- 
ing laboratory were compared on 22 teaching skills under two con- 
ditions. In condition one, 85 students completed microteach- critique 
cycles utilizing the 22 teaching skills. Audio tapes were used for 
the critique function. Students under condition two completed "reg- 
ular" teaching methods courses during the same period. Both groups 
completed pre and post audio taped teaching sessions. Statistical 
comparisons via analyses of covariances yielded statistically sig- 
nificant differences in favor of students under condition one on 17 
of the 22 teaching skills. Conclusions w€?re that microteaching is 
effective on a large scale teacher training basis and that it comple- 
ments a teaching laboratory situation. These results are supported 
by the findings of Nagel (1971) who also conducted research on large 
scale use of microteaching. 

Somewhat in contrast with previous findings about micro- 
teaching, Warren, Kallenback and Gall (1969) compared the teaching 
behaviors of eighteen elementary school interns who received con- 
ventional classroom observation and student teaching experiences 
to sixteen interns who received training in a summer microteaching 
program and found no differences in ratings of teacher effective- 
ness between the two groups. However, the microteaching group 
did perform as well and was trained in a shorter period (one fifth 
the time). 

Not all studies of microteaching showed improvement in 
teacher performance. Kocylowski (1971) compared three con- 
ditions of pre service training in business education: business 
methods lectures, business methods lectures and microteaching, 
and no training. She obtained pre to post decreases in questioning 
skills on videotaped samples of teaching performance on all three 
conditions but the decrease was significantly less for teachers 
under the microteaching condition. 

Similarly, Wagner (1971) found that microteaching was not 
a superior approach in teaching student teachers to use more stud- 
ent centered and less teacher centered behaviors. Students trained 
to discriminate between appropriate and inappropriate teacher be- 




18 



9 



haviors employed significantly more student centered and signifi- 
cantly less teacher centered behaviors in their student teaching 
experiences than did student teachers who were trained under the 
microteaching conditions. Student teachers who received no special 
training performed as well as student teachers in the microteaching 
group. 



To date, microteaching has not been examined extensively 
as a training tool for teachers of exceptional children. However, 
Andersen and Antes (1971) did attempt to gain information concern- 
ing the use of microteaching in the preparation of teachers of cul- 
turally diverse children. Although a pre-experimental design was 
employed which prevented the collection of controlled behavioral 
data, the authors systematically collected attitudinal and judge- 
mental information using 31 graduate interns who worked with 
Indian children, black children, and white children of low socio- 
economic backgrounds. Interns' reactions, judgements of video 
tape segments, and supervisor’s evaluations of each internship 
were examined. A low correlation between judgements on micro- 
teach segments and the supervisor’s evaluations did not permit the 
authors to conclude that a relationship exists between effectiveness 
in presenting a microteach lesson and effectiveness in teaching in 
a regular classroom later. The authors did conclude from student 
reactions that the primary value of microteaching lies in the op- 
portunity it provides in early teaching experience and in the self- 
analysis of teaching techniques. 



Since 1968, microteaching has been adapted to many diverse 
uses in instruction. Research now supports microteaching as used 
in training principals, supervisors of student teachers, counsellors, 
and in directly training children. 

In an interesting adaptation of microteaching combined with 
a token economy, Sadker (1971) trained four fifth grade students to 
ask higher order questions and to maintain the behavior. An A-B- 
A-B design was employed. Baseline observation data on occurence 
of higher order questions was first collected in the student’s class- 
room. Four students were then provided with demonstrations of 
higher order questions and instructed to microteach each other on 
use of the questions. Four matched students did not receive train- 
ing but were observed. In the next phase, tokens in the form of 
points for asking higher order questions were delivered to the stud- 
ents. The next two phases were termination of reinforcement and 
reinstatement of reinforcement. Control of students asking of higher 
order questions were demonstrated through increases from baseline 
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and through reversal of the effects via termination of the con- 
sequences. No increase in asking of higher order questions was 
noted for students who did not receive the demonstration, micro- 
teaching, token, treatment. 

In the areas of supervision and counselling, several 
studies of the utility of microteaching have been reported. 

Schaefer (1971) found value in the use of microteaching to im- 
prove principals' ability to conduct appraisal interviews with 
teachers. Schutte (1971) used the Flanders interaction analysis 
scale to evaluate the value of microteaching as a method of 
supervision for student teachers and found it to be a practical 
alternative to supervisor observations. Kise (1972) used micro- 
teaching, not as a substitute for supervision, but to change pos- 
itively the observational and advisement behaviors of student 
teacher supervisors. Seefeldt (1972) improved the attending and 
listening skills of school counsellors using a microteach format. 

Limbacher (1968) used participating high school pupils 
to evaluate lessons presented by social studies student teachers 
who received microteaching experiences. Videotapes of lessons 
and the Illinois Teacher Evaluation Questionaire were used to 
assess the effectiveness of 50 student teachers in experimental 
and control groups. The experimental group was shown to per- 
form significantly higher according to both measures. Con- 
clusions of the author were that on-campus training programs 
(microteaching) do have an effect on the practice teaching class- 
room behavior and that this effect can be measured in the field. 

In a survey of theNCATE accredited colleges and universities, 
Ward (1968) found that 141 of those who responded used microteaching 
in their secondary education programs. The majority (104) of 
these colleges and universities began using microteaching within 
the previous two years. A general trend was to incorporate micro- 
teaching in regular methods courses by condensing the course con- 
tent. Most of the programs used peers as subjects for microteaching. 
Many used the complete teach, critique, re-teach, re-critique cycle. 

Microteaching also has some support as an inservice 
teacher training procedure. Ashlock (1968) used an adapted micro- 
teaching procedure in an off-campus in-service elementary science 
and mathematics methods course. Each teacher was required to 
teach a five minute microlesson to peers in the class. The import- 
ance of stating lesson outcomes in terms of student behavior was 
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emphasized. Casual observation indicated that the students began 
to use many of the critical teaching skills designated by Allen and 
Ryan (1969). General recommendations were that some form of 
microteaching is invaluable in a methods course and that evaluation 
of microteaching should be based on a limited number of criteria. 

Although some inconsistencies in the findings on microteach- 
ing are evident, a preponderance of studies support the value of 
microteaching in teacher preparation programs. Positive results 
are demonstrated in a wide variety of situations including the in- 
service training of teachers. 



II. Literature on Minicourses 



Basic Components 

In addition to microteaching, research in other areas con- 
tributed to the development of the minicourse model along a research 
and development base. Research on feedback, as information to 
the learner about his performance, received a positive rating toward 
inclusion in the minicourse model (Borg, et al, 1970). The presenta- 
tion of filmed models to be imitated by course participants was favored 
over symbolic or live models both from a research and an economics 
standpoint (Borg, et al, 1970). The technical skills approach, which 
consists of the isolation of a single concept or teaching skill and de- 
fining it in behavioral terms, was selected as the format for presenta- 
tion in the filmed lessons. Video tape recordings and 16 mm films 
were selected as the primary media. 

The following list of findings about the components of the 
minicourse model are claimed by Borg, et al, (1970): 

1. Microteaching programs are more efficient and are 

at least as effective as conventional training programs. 

2. The technical skills approach to teacher training is 

a significant improvement over approaches that stress 
global definitions of teacher effectiveness. 

3. Models contribute to the development of classroom 
skills; filmed models are as effective as live models, 
and probably more effective than symbolic models. 
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4. Videotaped feedback contributes to skill develop- 
ment and can be effectively substituted for super- 
visor feedback. 

5. Sophistication of production techniques has little 
effect on learning, but subtitles, questions, and 
simple film commentary have a positive effect. 

We have pointed out that many research questions 
remain unanswered. Nevertheless, the staff of the 
Laboratory’s Teacher Education Program believe 
that enough research evidence existed to develop a 
new model of teacher training - the minicourse 
model - which would be a significant improvement 
over traditional approaches (p. 52). 



Field Test Procedures 

Data collection procedures used in the development of mini- 
courses have included: (1) preliminary field tests in which small 
groups of teachers are used to obtain observation and reaction data, 

(2) main field tests in which quantitative data on teacher performance 
is obtained, and (3) operational field tests in which planning and co- 
ordinating of the course is conducted by regular school personnel 
(Borg, et al, 1970). 

The main field test for Minicourse 1 (Borg, et al, 1970) is 
included in this review because it describes the initial groundwork 
and pattern of research for all minicourse field tests. The purpose 
of Minicourse 1 is to produce changes in twelve specific areas of 
teacher behavior which affect student participation levels. Teachers 
from twelve elementary schools, teaching fourth through sixth grade 
classes, received the Minicourse 1 presentation. Videotape record- 
ed samples of teacher behavior were collected prior to and following 
presentation of the minicourse. Frequencies of occurence of the 
twelve teacher behaviors were compared between pre and post video- 
tapings. Following completion of Minicourse 1, teachers showed 
significant increases in occurence of ten of the twelve teacher be- 
haviors. The authors reported that "Nine of these ten changes brought 
about by the minicourse appear large enough to be of practical as 
well as statistical significance" (p. 76). 

A review or refresher course for Minicourse 1 was develop- 
ed and tested with the intent of improving retention. One-third of the 
original sample of teachers from the main field test were used (Borg, 
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et al, 1970, p. 87). Another third of the sample was given class- 
room observation and feedback assistance on the skills covered in 
the course. The remaining third of the teachers served as a control 
group and was shown unrelated instructional films. Results indicated 
a slight tendency for teachers who took the refresher course to per- 
form better in relation to the skills in question. The authors gave 
the reason for so little difference as being that the teachers did not 
need a refresher course. 

Following modifications to Minicourse 2 through preliminary 
field tests, three major field studies were conducted in California 
and in Pennsylvania (Borg, et al, 1970). The objective tested for 
Minicourse 2 was "... to develop teaching skills that lead to lan- 
guage learning by kindergarten children with minimal language back- 
ground" (p. 117). Forty-seven teachers of black migrant, white 
migrant, Mexican-American, and black urban pupils were presented 
Minicourse 2. Post instruction videotape samples indicated signifi- 
cant mean changes in teacher behavior on extending phrases to 
sentences, form of praise, modeling of positional words, and sev- 
eral other skills taught by Minicourse 2. 

The main field test for Minicourse 5, which is the subject 
of this investigation, was conducted with teachers in predominantly 
middle-class school districts (Borg, et al, 1970). The goal of Mini- 
course 5 as stated is ". . . to increase the skill of elementary school 
teachers in individual tutoring of pupils deficient in their understand- 
ing of mathematical concepts and procedures" (p. 141). Scoring and 
analysis of pre and post treatment videotape samples according to 
the skills taught in Minicourse 5 indicated significant improvement 
in use of verbal praise, diagnostic questions, demonstration tech- 
niques, and assigned practice examples. No difference was reported 
in the assignment of evaluation; examples. Tutoring time increased 
among 77 percent of the teachers. A shorter replication study con- 
firmed the results of the main field study, the experimenters indi- 
cated that Minicourse 5 was successful in achieving it’s objectives 
in that it did bring about observable improvement in mathematics 
tutoring skills of elementary school teachers. Data were not gath- 
ered on the effects of Mini course 5 on mathematics performance of 
pupils. 



In an effort to gain information on the value of microteach- 
ing and the minicourse model with subjects other than experienced 
teachers, Borg, Kallanbach, Morris, and Friebel (1969) conducted 
a study in which groups of student teachers from three teacher 
training colleges either completed all the components of Minicourse 
1, completed parts of minicourse instruction, or did not participate 
in minicourse instruction. Students who completed the entire mini- 
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course or parts of minicourse instruction demonstrated significant 
pre to post gains on several of the skills observed. No definite 
trends in differences were evident among the participating groups. 
The authors reported that the students had difficulty completing 
both their regular responsibilities and the minicourse assignments 
but concluded that in spite of administrative problems, the mini- 
course model shows promise as a tool for changing student teacher’s 
behavior. 

Nursing educators have also utilized minicourse instruction 
in their programs. Egbert (1971) reported a study in which a group 
of 29 graduate nurses receiving minicourse instruction and additional 
audio visual cues were compared to a group of 27 graduate nurses 
who discussed general strategies of questioning and used a micro- 
teaching format. Differences in favor of minicourse instruction were 
reported for all questioning techniques, and statistically significant 
differences were reported for redirection and clarification. It was 
concluded that the minicourse protocol was an effective agent in the 
training program. 

Those minicourses such as Minicourse 1, Minicourse 2, 
and Minicourse 5, which have undergone the complete test and re- 
vision cycle, are of demonstrated utility in changing teacher be- 
havior both from the standpoint of statistical significance and 
practical significance (Borg, et al, 1970). 

in. Literature on Remedial Mathematics Instruction 



Literature on remedial mathematics instruction is reviewed 
in this study because of the direct relationship which exists between 
curriculum and research in educational research and development. 
The design and development of Minicourse 5 was dependent upon the 
selection of mathematics tutoring techniques which research showed 
to be most successful (Borg, et al, 1970). Likewise, the research 
procedures employed in the major field test of Minicourse 5, such 
as data collection procedures, were adapted to the special require- 
ments of tutoring in mathematics. 

Remedial mathematics instruction research as reviewed in 
this paper includes studies which are described by the experimen- 
ters as including activities which contrast with "conventional” or 
"regular" mathematics classroom activities in one or more of the 
following respects: (1) individualization through grouping, pacing, 
individual teacher attention, programmed materials; (2) ongoing 
diagnosis within the instructional framework; (3) demonstration of 
mathematical concepts and procedures on the part of the teacher 
followed by opportunity for supervised practice by the student. 
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Bernstein (1959) reviewed over 200 reports of research on 
remedial mathematics programs. He included individual diagnosis 
and lesson plans, individualized teaching, and common types of 
arithmetic errors as important elements in all the studies he re- 
viewed. In summarizing the results of the research, he concluded 
that it is amazingly apparent that all of these procedures have pro- 
duced some good results" (p. 194). 

In a two-year investigation of a remedial teaching program 
with seventh and ninth grade students, Thompson (1941) reported 
significant gains in mathematics achievement over students who 
did “J 4 Participate in the program. Likewise, Gailer and Hoffman 
(1943) obtained similar results with 108 ninth grade students who 
participated in a remedial prograii. in which individualized instruc- 
tion techniques were employed. 

Tilton (1947) employed more stringent research controls 
and investigated the application of a remedial instruction program 
in addition, subtraction, and multiplication with fourth grade stud- 
ents. Following a four-week period of tutoring for twenty minutes 
per day, the experimental group showed a mean achievement gain 
of nearly six months over the control group. 

Dreyfus (1969) reported the development of a remedial 
mathematics program for junior high school students who were dis- 
advantaged. The program included activities such as tutor help, 
audio tape, records, programmed texts, individual and small group 
work, weekly evaluation by counselors, field trips, and guest speak- 
ers. The program produced significantly higher achievement in 

*5® n that attained by a control group. Lerch and Kelley 
(1966) obtained comparable results with a class of slow learners. 

Sherer (1968) used self developed materials including draw- 
ings, counters, number lines, and charts to teach low achieving 
pupils in grades three through seven and found that his procedure 
produced significantly greater gains in arithmetic achievement than 

Wh ® n o! udentS were taught b y conventional methods. In contrast 
with Sherer 's results, DeVeney (1969) found that a special program 
developed for low achievers was not as adequate as a conventional 
program in improving mathematics achievement. 

Bernstein (1956) used special practice material organized 
according to diagnosis of individual student deficiencies with ninth 
grade students to produce significant gains in mathematics achieve- 
ment. He also provided individual instruction in a mathematics 
clime and found this procedure to be more effective than working 
with individual students within the regular class* 
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The use of peers and volunteers as tutors has also been re- 
ported to be an effective remedial mathematics instruction approach. 
Olsen (1969) used volunteers to tutor primary grade underachieving 
children and obtained favorable results. Other research (Cloward, 
1967; Ellson, Harris & Barber, 1968; Gross, 1968) strongly support 
the use of peers as supplementary tutors. 

In summary, this review of literature shows that microteach- 
ing and minicourses are effective as teacher training approaches, 
that remedial mathematics instruction can be a worthwhile endeavor, 
and that Minicourse 5 is a definite factor in modifying the mathematics 
tutoring behavior of elementary teachers. However, a search of the 
literature does not indicate the value of Minicourse 5 as an agent for 
improving the tutoring skills of special education teachers. Nor 
does the literature indicate what changes occur in the pupils of teach- 
ers who receive Minicourse 5 instruction. 



Problem 



In view of the limited nature of previous research on Mini- 
course 5, the problem of the present study was the lack of evidence 
to answer the following question: Does Minicourse 5 have utility for 
teachers of educable mentally retarded children with respect to 
(1) improving mathematics tutoring skills immediately following in- 
struction (one month), (2) the maintenance of improved mathematics 
tutoring skills over a period of several months (six months), and 
(3) measured improvement in mathematics performance of their 
students ? 



Objective and Hypotheses 
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In light of the need for valid in-service training programs 
for special education teachers, the objective of this experiment was 
to assess the utility of Minicourse 5 when presented to teachers of 
educable mentally retarded children. Assessment of the mathematics 
tutoring behavior of teachers and the mathematics achievement of 
their students were the sources of data. 

The hypotheses tested were: 

1. Differences (p<.05) would occur in the direction 
of increases in frequencies of verbal praise, 
prompting questions, diagnostic questions, dem- 
onstration techniques, evaluation and practice 
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techniques between scores of pre and post Mini- 
course 5 videotapes of teachers of educable 
mentally retarded children with respect to 
mathematics tutoring skills. 

2. Differences (p<.05) would occur in the direction 
of increases in frequencies of verbal praise, 
prompting questions, diagnostic questions, dem- 
onstration techniques, evaluation and practice 
techniques between scores of pre course and post 
followup (six months) videotapes of teachers of 
educable mentally retarded children on mathematics 
tutoring skills. 

3. Differences (p<. 05) would occur in the direction 

of greater improvement in mathematics performance 
for students of teachers who have participated in 
Minicourse 5 as compared to mathematics per- 
formance of students of teachers who have not 
participated in Minicourse 5. 
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PROCEDURE 



The introductory section of the report described the uses 
of minicourses for teacher training and suggested that they may be 
useful in training special education teachers. Literature was re- 
viewed pertaining to the basic elements involved in developing Mini- 
course 5: the success of microteaching, the usefulness of techniques 
for individualizing remedial mathematics instruction, the employ- 
ment of a research and development procedure. This section is de- 
voted to describing the methods employed in assessing the utility of 
Minicourse 5 as an in-service training package for special education 
teachers. 

This study entailed a three step procedure. Step 1 was the 
development and selection of instrumentation; step 2 was the pilot 
study in which tests were tried out and revised ; step 3 was the main 
field study. 



Development and Selection of Mathematics 
Achievement Tests 



Mathematics Content Referenced Test 

The mathematics performance of students involved in this 
study was assessed using two measures: a test based upon analy- 
sis of the content of mathematics instruction utilized by the teach- 
ers the sample (content referenced test) and the mathematics 
section of a standardized, achievement test (Wide Range Achieve- 
ment Test). Two measures were used to provide a broader base 
from which to assess the impact of the minicourse training. 

The development of a content referenced test was based upon 
the assumption that a test which samples the exact content of instruc- 
tion would be more sensitive to the treatment than the broader sam- 
pling of content by a standardized achievement test. The content 
analysis was conducted utilizing rankings in order of importance of 
those mathematics instruction tasks and subtasks which were included 
in the content of instruction by 9 teachers of educable mentally re- 
tarded children in the Cache and Box Elder School District. Teach- 
ers in the Salt Lake City School District were not used for this initial 
content analysis because of the possibility of experimental contamina- 
tion. However, teachers who participated in the main field study did 
complete an analysis of the content referenced test after the experi- 
ment was concluded. 
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The content referenced test was arranged in four parts 
(Appendix C). Items in part I were concerned with testing number 
recognition, counting, number sequencing, number writing, and 
time telling skills. Part II was concerned with testing mathemat- 
ical concepts using number line problems, problems dealing with 
concepts of equality, place value, expanded notation and simple 
story problems. Part m was concerned with testing math facts and 
use of basic number operations. Items in part IV dealt with frac- 
tions, converting measurements, percentages, averages and higher 
level number operations. Parts I and II were administered to each 
class as a group with ongoing oral directions. Parts ID and IV were 
also administered to each class as a group but no oral directions were 
provided once the test was begun. Average administration time was 
50 minutes and tended to vary since no time limit was set for Parts 
I and n of the test. 



Wide Range Achievement Test 

The level I section of the Wide Range Achievement Test 
(Jastak & Jastak, 1965) was selected among several standardized 
achievement tests (Appendix D) for the following reasons: 

1. Test items extend intopre computation levels 
and range upward into advanced mathematics 
levels. 

2. Administration time is relatively short (10 min- 
utes). This was an important factor in gaining 
school district cooperation. 

3. The test has a past history of usefulness in 
classes for the educable mentally retarded 
(Delong, 1962). 



Pilot Study 



The general purpose of the pilot study was concerned with 
establishing workable field test administration and data gathering 
procedures. Four objectives were specified: 

1. To identify problems encountered in the operation 
of equipment by the teachers. 
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2. To obtain information concerning the applicability 
of the selected measures of student mathematics 
performance. 

3. To standardize administration procedures between 
testing assistants on the selected measures of 
student achievement. 

4. To validate the effectiveness of a locally developed 
content based test of student mathematics perform- 
ance. 

A group of pupils who were enrolled in the Edith Bowen 
School summer program (campus demonstration school at Utah 
State University), grades two to five, were identified by their 
teachers as exhibiting difficulty in basic computational or verbal 
reasoning skills. Each was administered the Wide Range Achieve- 
ment Test (WRAT - Arithmetic section) and the locally developed 
mathematics content referenced test. Fifteen pupils who performed 
lowest on the tests were selected as tutorial subjects. During the 
Utah State University summer session, Minicourse 5 was presented 
to twelve university students who were enrolled in a mathematics 
methods course. In addition to viewing the filmed lessons, the 
university students conducted nine microteach - reteach tutoring 
sessions using the Edith Bowen School pupil(s) assigned to them. 

The University students audio taped and critiqued each micro-teach 
session using cassette recorders. The instruction period was four 
weeks. The Edith Bowen pupils were then re-tested using the WRAT 
and the mathematics content referenced test. Each university stu- 
dent audiotape recorded a 20 minute pre-course and post-course 
tutoring session. Post course evaluation questionnaires were com- 
pleted by each participant. Results of the pilot study will be pre- 
sented along with the results of the main field study in chapter four. 



Main Field Study 



The experimental portion of the investigation was conducted in 
the Salt Lake City School District throughout the 1971-72 school year. 
Duration of the experimental period was seven months. Approximately 
three weeks was allowed for the two test administrations and three 
teacher videotapings. The remainder of this chapter is devoted to a 
description of procedures which were employed in the main field study. 
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Population 

The population of concern for this experiment included both 
teachers of classes for educable mentally retarded (EMR) children 
and the students enrolled in the classes within the Salt Lake City 
School District. Thirty-eight teachers of lower primary, upper 
primary, junior high and senior high classes for EMR children were 
employed within the Salt Lake City School District. Teaching ex- 
perience ranged from one year to 26 years, and the average was 6 
years. The majority of the teachers had completed at least 13 
credit hours of course work in the field of special education and all 
held at least minimum teacher certification for the State of Utah. 

Students in the classes for EMR children were placed according to 
the guidelines set down by the State Department of Public Instruction 
(1965). Chronological ages of students ranged from 6 years to 18 
years. Classes were organized under the categories lower primary, 
upper primary, junior high, and senior high. Average I. Q. scores 
according to school records ranged between 55 and 75. Class size 
ranged from 6 to 16 pupils. 

The subjects for this experiment were comprised of all lower 
primary, upper primary, junior high, and senior high teachers and were 
derived from the target population of teachers who agreed voluntarily 
to participate in the experiment. The students of these teachers also 
served as subjects. A general recommendation by the Far West 
Laboratory was that participating teachers be volunteer s (Borg et 
al, 1970). Twenty-five teachers agreed to participate in the experi- 
ment. Approximately 240 students were enrolled in the participating 
teachers’ classes at the beginning of the experiment and 320 students 
were enrolled at the end of the experiment. Enrollment in special 
education classes in the Salt Lake City School District increased 
during the school year. 

Names of participating teachers were assigned consecutive num- 
bers and these numbers were assigned to one of two groups (experi- 
mental group and control group) using a table of random numbers 
(Garrett, 1962). Following suggestions by Borg (1970) the minimum 
acceptable size of the experimental group was set at fifteen teachers 
and no experimental group teacher was located in the same school as 
a control group teacher. The teacher assignment ratio was set at 
three to two (experimental group to control group) and the random 
assignment process was continued until fifteen teachers were assigned 
to the experimental group who were not located in the same school 
as teachers who were assigned to the control group (Table 1). 
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Table 1. Assignment of teachers to groups by schools. 



School 


Experimental Group 
Number of Teachers 


Control Group 
Number of Teachers 


Irving 


2 




Highland 


2 




Rose Park 


1 




Riley 


3 




Jordan 


2 




South 


3 




Webster 


2 




Riverside 




2 


West 




3 


Horace Mann 




3 


Jackson 




2 


Total 


15 


10 



One of the fifteen teachers in the experimental group completed 
the Minicourse 5 instruction and employed the techniques until the last 
week of January, 1972. At this time he left his teaching post. This 
teacher's videotape samples were not included in the scoring since a 
final sample could not be obtained for him. However, the data from 
the students in his class were included in the final analysis because 
many of these students received instruction from other teachers in 
that school who were in the experimental group. 



Environment 



The experiment was conducted in eleven different schools. 
Teachers in the experimental group were located in seven schools - 
three elementary schools, two junior high schools, and two senior 
high schools. Teachers in the control group were located in four 
schools - two elementary schools, one junior high school, and one 
senior high school. Most schools utilized the standard 700 square 
foot classroom. Two elementary schools had eliminated wall parti- 
tions between classrooms and had established individual table work 
or tutoring areas in the halls. TWo teachers in one of these schools 
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were in the experimental group and two teachers in the other school 
were in the control group. 

Microteach sessions were conducted in a variety of areas: 
health rooms, teachers' lounges, libraries, quiet hallways, and sec- 
luded portions of the teachers' classrooms. Directions to Minicourse 
5 field coordinators (1971, p. 30) indicated that a room with dimen- 
sions of 10 feet by 12 feet was a desirable size for microteaching but 
that smaller rooms have been used. A "good sized table" was also 
recommended so that the students' instructional material may be 
spread out before them. Videotape samples of mathematics tutoring 
behavior were collected in the same areas. The Minicourse 5 films 
were viewed by teachers wherever convenient within the school. 
Minimal ambiant noise and interruptions from staff or students was 
a suggested criterion for room selection. 

Administrations of mathematics performance tests were con- 
ducted on a group basis in each teacher's classroom. Rooms varied 
to some extent in types of equipment included within them, but in gen- 
eral they conform to the conventional classroom size of 700 square 
feet (Davies, 1971). 

Equipment 

The Minicourse 5 lessons were presented via 16 mm film pro- 
jectors which were provided by the Salt Lake City School District. 
Various models of Bell and Howell and Kodak projectors were avail- 
able in each school. Fifteen audiotape recorders and accompanying 
microphones were used by the teachers in the experimental group for 
the microteach sessions. Data have been collected which suggested 
that teachers participating in Minicourse 5 may employ audio-tape 
recording equipment for critiquing microteach sessions with no ap- 
preciable drop in evaluative effectiveness (Gall, Dell, Dunning, & 
Galassi, 1971). 

Videotaped samples of teachers' mathematics tutoring skills 
were collected for the pre and posttapings using the following equipment: 

1. Two Sony AV 3400 1/2 inch videotape recorders 

2. Two Sony nine inch monitors 

3. Two Sony cameras 

4. Two camera Tripods 
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5. Two Sony microphones with microphone stand adapters 

6. Two Sony power adapters 

7. Two zoom lenses 

Treatment 



A combination of two research designs as described by 
Campbell and Stanley (1967, pp. 11, 13) were selected for this 
experiment. First, the one group pretest, posttest design and 
second, the pretest, posttest, control group design are shown in 
Figure 1. Following determination of the sample, teachers were 
randomly assigned to either an experimental group or a control 
group. The teachers assigned to the control group did not serve as 
controls but their students served as controls for students of teachers 
assigned to the experimental group. A control group of teachers was 
not included for two reasons: (1) Feedback from school district staff 
indicated that they were not in favor of teachers devoting class time 
to a research project when they do not participate in the treatment in- 
struction, and (2) informal observational data indicate that mathe- 
matics tutoring behavior of teachers . .was fairly stable and not 
likely to be affected by such confounding factors as time of year or 
pupil maturation" (Borg, et al, 1970, p. 53). 

Teachers assigned to the experimental group participated in 
tutoring sessions in which pre, post, and second post experiment 
videotape samples were collected. Their students were administer- 
ed pre and post experiment mathematics performance tests. These 
teachers individually viewed the Minicourse 5 instructional and model 
lessons and carried out microteach and re-teach sessions as pre- 
scribed by the Teacher handbook (1970). 

Teachers assigned to the control group were not administered 
pre and post experiment videotapes, did not view Minicourse 5 instruc- 
tional nor model lessons, nor were they instructed to carry out micro- 
teach or re-teach lessons, but conducted their usual classroom instruc- 
tional duties during the experimental period. They were not specifically 
told that their students were to serve as controls but they were told 
that they would participate in a second administration of Minicourse 
5 at a later date. Students of teachers assigned to this groi?) were 
administered pre and post experiment mathematics performance 
tests. In essence, the primary purpose of assigning teachers to this 
group was to obtain two comparable groups of students through random 
assignment of their teachers (Figure 1). 
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Figure i MINICOURSE 5 EVALUATION PROJECT 
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Minicourse 5 entitled "Effective Tutoring in Elementary 
School Mathematics, " was presented to teachers in the experimental 
group immediately following completion of the pre treatment admin- 
istration of the assessment measures which consisted of the WRAT 
and the Mathematics Content Referenced Test. The course sequence 
included collection of precourse video tape tutoring samples, an in- 
troductory film, five instructional and model films, a teacher hand- 
book, four microteach sessions, three re-teach sessions, a course 
evaluation questionnaire, and six monthly followup lessons. The view- 
ing of lessons, microteaching, and re-teaching was scheduled over a 
one-month period (October, 1971). The six followup lessons were pre- 
sented to the teachers via the teacher handbook. Teachers reviewed 
lessons presented in the teacher manual and conducted microteach 
sessions appropriate to the lessons. The follow-up lessons were com- 
pleted at the rate of one per month beginning one month following com- 
pletion of Minicourse 5. 



Data Collection 



Teachers in the experimental group were videotaped during 
mathematics tutoring sessions on three separate occasions*. (1) be- 
fore the first Minicourse 5 session (pre course sample), (2) following 
completion of five instructional lessons and microteach sessions (post 
course sample), and (3) following completion of the six followup les- 
sons (second post course sample). Each videotape was 20 minutes in 
length. Borg, et al (1970) described the videotape sampling procedure 
conducted in the main field test of Minicourse 5 as utilizing two ten 
minute samples, one sample including tutoring in verbal problems. 
This procedure was found to be impractical for the present study since 
so few of the children in the sample were working on or close to the 
verbal problem level. Therefore, no instructions were given or 
limitations were set for the teachers as to the content of their mathe- 
matics tutoring sessions. 

Scoring of Videotape Tutoring Samples 

The pre and post experiment videotapes were scored using 
the system developed by Far West Laboratory (Appendix E). All 
videotapes were randomly assigned to scorers with pre tapes and 
post tapes not identifiable. All videotapes were scored during 
a one week period. Six Utah State University undergraduate students 
were employed as scorers and were trained using the following steps: 
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1. Scorers were paired and assigned the task of scoring 
one of three sets of teacher behavior. 

2. Each scorer then read a folder containing scoring in- 
structions which were appropriate to the assigned 
scoring set (Appendix E). 

3. Each scorer was then provided a training audio tape 
which contained excerpts from the videotaped tutor- 
ing sessions. Using the scoring sheets (Appendix F) 
he practiced scoring his assigned set. 

4. As a final step, a test audio tape which also contained 
excerpts from the videotaped tutoring sessions was 
scored by each of the scorers. A criterion of 90% 
correct was required before the scorers were per- 
mitted to begin scoring the videotape samples. 

5. Criterion was not reached on the first trial by two 
of the scorers. These scorers again read the scor- 
ing instructions, scored the training tape and met 
criterion on the second trial. 

6. Scorers were informed that they would receive a 
monetary bonus if they maintained criterion scoring 
accuracy. 

The scoring was conducted in two rooms which contained video- 
tape playback equipment. Scorers were provided typed transcripts of 
each videotape. No two scorers were permitted to score the same set 
of tutoring behaviors in the same room. Each scorer completed the 
scoring on a pre-course, post-course, and delayed post course video- 
tape for each teacher making a total of 42 videotapes for each of the 
six scorers. 



Test Administration 

The content referenced test and the Wide Range Achievement 
Test were administered to students in the experimental and control 
groups during the last week of September, 1971 and the second week 
of April, 1972. A random assignment procedure was used so that the 
order of administration on the content referenced test and the WRAT 
to each class was alternated. Both tests had an equal chance of be- 
ing administered first. Teachers were asked to leave the room while 
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the tests were being administered to their classes. The testing 
assistants (three undergraduate and one graduate university stu- 
dent) were instructed in the administration of the content referenced 
test and the WRAT (Appendix G). The testing assistants returned 
to each class in which students were absent during the first admin- 
istration of the tests and allowed those students to take the tests. 
Students who obtained a score of less than five on the first line of 
the written portion of the WRAT were then individually administered 
the oral portion of the WRAT as per administration directions (Ap- 
pendix G). The testing assistants were not informed as to which 
classes were experimental and which were control. The tests were 
scored by the testing assistants according to the directions provided 
in the administration instructions (Appendix G). 



Procedures for Statistical Analysis 



Data were analyzed using two statistical procedures. Hy- 
potheses One and Two were tested using the t-test for related 
samples (Ferguson, 1971) and the Wilcoxon matched-pairs, signed- 
ranks test (Seigel, 1956). A parametric and a non-parametric test 
were selected to test the statistical significance of the difference 
between difference scores on matched-pairs of videotape scores 
since there is a probability of some scores yielding markedly skew- 
ed distributions (Borg, et al, 1970, p. 158). Hypothesis Three was 
tested using analysis of covariance. Specialized formulae have been 
developed for use of analysis of covariance when intact classes are 
the units of random distribution (Lindquist, 1956). The analysis of 
covariance program developed by the Utah State University Computer 
Center is designed to account for intact classes used as measurement 
units and was employed in this analysis. Pretests of the content ref- 
erenced and standardized achievement tests were used as covariates. 
A descriptive procedure was employed to examine teachers' evalu- 
ation of the Minicourse 5 components. 
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RESULTS AND DISCUSSION 



The results of Far West Laboratory’s main field study demon- 
strated that Minicourse 5 can improve the mathematics tutoring be- 
haviors of teachers in regular elementary classes. To date, the 
utility of Minicourse 5 for teachers in special education classes has 
not been determined. Nor has the validity of minicourse instruction 
been demonstrated through results on student’s performance. This 
section will present and discuss the results of the present experiment 
which was carried out to determine the effectiveness of Minicourse 5 
with teachers of educable mentally retarded children and to determine 
whether the effects of teachers’ participation in Minicourse 5 can be 
realized in improvement in the mathematics performance of their 
students. 

The results will be presented in five sections; reliability and 
validity of dat" collection instruments, pilot study results, teachers’ 
mathematics tutoring skills, mathematics performance of students, 
and teachers’ evaluations of Minicourse 5. An overview of results 
will conclude this chapter. 



Reliability and Validity of Data 
Collection Instruments 



Reliability Between Scorers of Video- 
Taped Tutoring Samples 

Interscorer reliability was computed for each of the three 
scoring sets (scoring sets were grouped according to techniques pre- 
sented in each lesson) using a Pearson Product Moment correlation 
coefficient (Fergusen, 1971). Results of the computations are pre- 
sented in Table 2. Correlations for tutoring techniques scored in set 
I ranged from . 79 on specific verbal praise to . 98 on the total of all 
five techniques. The mean of the correlations for set I was . 91. 
Correlations for tutoring techniques scored in set II ranged from . 81 
on word definitions to . 97 on number operations. The mean of the 
correlations for set II was also . 91. Correlations for demonstration 
techniques, which were scored in set in ranged from . 62 on use of 
number sentences to 1.00 on use of number lines and practice assign- 
ments and the mean of the correlations for set ID was . 89. Since a 
mean correlation of .80 was set as an acceptable level, interscorer 
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Table 2. Reliability Coefficients Between Scorers of 

Videotaped Mathematics Tutoring Sessions 



sessions 

SET correlation scored 



Prompting Questions 


.97 


42 


Student Responses 


.96 


42 


General Verbal Praise 


.99 


42 


Specific Verbal Praise 


. 79 


42 


Declaratives 


. 82 


42 


Total 


.98 


42 


General Diagnostic Questions 


.88 


42 


Read the Problem 


.98 


42 


Word Definitions 


.81 


42 


Renaming, Regrouping, Place Value 


.93 


42 


Number Operations 


.97 


42 


Total 


.97 




Estimation 


.95 


42 


Expanded Notation 


.99 


42 


Number Line 


1.00 


42 


Manipulatives 


.97 


42 


Diagram/Picture 


.87 


42 


Number Sentence 


. 62 


42 


Evaluation 


. 76 


42 


Practice 


1.00 


42 


Total 


.96 


42 



Techniques scored in set I correspond to the tutoring skills presented 
in lesson 1, techniques scored in set n correspond to the tutoring skills 
presented in lesson 2, and techniques scored in set m correspond to the 
tutoring skills presented in lessons 3 and 4. 
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reliability was judged to be sufficient. Results of the analyses on 
scorings of the mathematics tutoring sessions are presented in the 
section which follows. 



Reliability and Validity of the Mathematics 
Content Referenced Test 



Reliability of the content referenced test was computed using 
a split half method (Borg & Gall, 1971) with the Pearson Product 
Moment correlation coefficient (Table 3). Approximately ten percent 
(40) of the administered pre and post experiment tests were randomly 
selected. Test items were paired according to level of difficulty and 
numbered odd and even. Correlations on the split halves and on the 
total of the four test parts ranged from . 84 on part IV to . 98 on part 
III. The mean correlation for all test parts was . 90. The obtained 
reliability levels were judged to be satisfactory since a criterion cor- 
relation of . 80 was set as minimally acceptable. 



Table 3. Reliability of the Mathematics Content Referenced Test 



Test 


N 


Correlation 






Coefficient 


Part I 


40 


.90 


Part II 


40 


.89 


Part III 


40 


.98 


Part IV 


40 


.84 


Total of Parts I, n, III, IV 


40 


.97 



An index of content validity of the content referenced test was 
also derived. Following final data collection, teachers in the experi- 
mental and control groups were asked to complete questionnaires cor- 
responding to each of the four test parts and thereby provide their 
estimate of the validity of the content referenced test in relation to the 
content of their mathematics instruction during the 1971-72 school year 
(Appendix F). Teachers rated each test item area on a zero to five 
scale (Table 4), zero being not applicable and five being very applicable. 
Many teachers included written suggestions for improving test areas. 
Teachers' average ratings were above two on Parts I and n, were above 
three on Part HI and were below two on Part IV. A validity criterion 
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Table 4. Teachers’ ratings of Mathematics Content Referenced 
Test items. 



Test Item 


Number of 
Respondents 


Mean 

Ratings 


Circling numbers 


22 


1. 81 


Object-number matching 


23 


1.95 


Object counting 


21 


2.00 


Counting money 


22 


3. 90 


Clock numbers 


22 


3. 59 


Number size relationships 


22 


3. 77 


Arabic to printed number 


24 


3. 54 


Countir ; pennies 


22 


3. 22 


Time telling — hour, half hour 


22 


4. 04 


Time telling— 15, 10, 5, 1 minute intervals 


22 


3. 86 


Write problems for number line 


23 


2.25 


Draw number line for a problem 


21 


2. 19 


Equality problems, addition and subtraction 


22 


3. 45 


Expanded notation problems 


22 


3.22 


Expanded notation in a subtraction problem 


22 


2.54 


Expanded notation in multiplication problems 


22 


2.04 


Simple story problems 


21 


2.47 


One place addition 


22 


3. 86 


One and two place subtraction 


22 


4. 31 


Column addition 


22 


4. 13 


One place multiplication 


22 


3. 04 


One place division 


22 


2. 45 


Decimal/money computations 


21 


3.00 


Two place addition 


22 


3. 85 


Two place subtraction 


22 


3. 95 


Three place addition 


22 


3. 72 


Three place subtraction 


22 


3. 54 


Two and three place multiplication 


22 


2.27 


Two and three place division 


22 


2.00 


Addition of fractions 


22 


1. 68 


Subtraction of fractions 


22 


1. 63 


Linear measurement 


22 


1. 90 


Time conversion 


22 


1 81 


Liquid/weight measurement 


22 


1. 86 


Percent, averaging, decimal measurement, 
decimal conversion 


22 


1.45 
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was established prior to scoring the questionnaires. Parts I, II, and 
III of the content referenced test met the criterion of an average mini- 
mum rating of two. Part IV did not meet this criterion. Although 
Part IV and the first two items of Part I were given the lowest rating 
by teachers, this does not necessarily suggest that these test items 
are entirely invalid. The extremities of a continuum would be expect- 
ed to be less representative of all the classes than would those items 
which are closer to the center of the range of items. It is remarkable 
that the items on the lower and upper extremes of the continuum all 
received average ratings that were above one. 

Concurrent validity was also computed between the content re- 
ferenced test and the Wide Range Achievement Test (Table 5). A 
Pearson Product Moment Correlation coefficient yielded a correlation 
of . 89 between the total of Parts I, n, IE, IV and the Wide Range 
Achievement Test (WRAT) which indicates acceptable concurrence 
between the two tests. Concurrence between the WRAT and isolated 
test parts ranged from . 53 to . 85 with a mean correlation of . 74. 

Since each test part of the content referenced test measures a specif- 
ied narrow range of mathematics performance, considerable variabil- 
ity in concurrence is expected as the WRAT measures a relatavely 
broad range of mathematics performance. The . 53 correlation bet- 
ween the WRAT and Part IV of the content referenced test corresponds 
with the low validity rating given Part IV by teachers. 



Table 5. Concurrent validity between the Mathematics Content Refer- 
enced Test and the Wide Range Achievement Test 



Test 




N 


Correlation 

Coefficient 


Content Test 
Part I 


- WRAT 


40 


.85 


Content Test 
Part n 


- WRAT 


40 


.73 


Content Test 
Part in 


- WRAT 


40 


.85 


Content Test 
Part IV 


- WRAT 


40 


.53 


Content Test 
Total 


- WRAT 


40 


.89 
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Reliability of the Wide Range 
Achievement Test 



Jastak and Jastak (1965, p. 14) report split-half reliability 
coefficients ranging between .94 and . 97 on administrations of the 
WRST level I arithmetic test to a broad sampling of children be- 
tween the ages of five and eleven years. As a part of this study, a 
reliability coefficient was computed using a Pearson product- moment 
correlation procedure on the split halves of ten percent (40 of the 
administered pre and post experiment tests which were randomly 
selected. The high test stability reported by Jastak and Jastak (1965) 
and Delong (1962) is supported by this study’s correlation of . 95. 



Pilot Study Results 



Equipment Operation 

In keeping with the purpose of the pilot study, the discus- 
sion of results is concerned with changes in instrumentation and 
procedures found to be necessary. The pilot study participants 
required virtually no training in use of audio cassette recorders 
and indicated that they were of value in the microteach-critique 
function which tends to support the findings of Gall and others (1971), 
The low cost factor and wide availability of audio tape recorders 
permitted the use of several back-up machines (a definite advan- 
tage in field situations). The pilot study demonstrated the feas- 
ibility of using audio tape recorders in conjunction with Minicourse 
o from a management standpoint. 



Testing Procedures 

Little difficulty was incurred in the pre and post course 
administrations of the WRAT. However, it was observed that al- 
lowances had to be made in the main field test for numerous admin- 
istrations of the oral section of the test. When a subject did not 
meet the minimum criterion score of five points on the written 
group administered section, testing assistants returned at a later 
date and administered the oral section individually. The pre course 
administrations of the content based test required several impromptu 
clarifications of directions to subjects. The administrations were 
audio tape recorded and the recordings were used to revise the 
directions for a tryout in the post course administrations. Little 
further revision of the directions was necessary. Seventeen test 
items which generated confusion among the pilot study subjects 
were also revised. 

4*1 
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Participants* Evaluation 

In assessing the utility of Minicourse 5 during the pilot study, 
the university students rated both their interest in the course and 
value received from the course in the upper levels of a five point 
scale (Table 6). The numbers to the right of items 3 and 4 of Table 
6 represent the number of participants who made that particular 
suggestion. Suggestions are ranked from top to bottom according 
to frequency of occurence. 



The pre, post, and second post videotape samples which 
were collected from teachers who participated in the main field 
test were scored during a one-week period. Three scorings were 
grouped for analysis according to the order in which the skills were 
presented in the Minicourse 5 lessons. 

Mean Scores for Occurences 
of Tutoring Skills 

The tutoring techniques scored for each lesson are listed in 
order in Table 7. Scorings based on Lesson 1 included prompting 
questions, corresponding student responses, general verbal praise, 
specific verbal praise, and declarative statements. Scorings for 
Lesson 2 included general diagnostic questions, read the problem 
statements, word definition questions, questions concerning re- 
naming, regrouping, and place value and number operations. Scor- 
ings for Lesson 3 included techniques for estimating answers, use 
of expanded notation, number lines, manipulative materials, draw- 
ing diagrams and pictures of problems, and use of number sentences. 
Scorings for Lesson 4 included techniques of assigning evaluation 
and practice problems. Lesson 5 was concerned largely with in- 
creasing tutoring time and no specific techniques were scored. 

Inspection of mean scores for pre and post video tapes of 
mathematics tutoring sessions reveals small increases in teachers' 
use of prompting and praising techniques except for large increases 
in use of specific verbal praise (Table 7). Student responses to 
prompting questions decreased ten points between pre and second 
post video tapes. Large increases in mean scores were noted for 
all types of diagnostic questions. Teachers increased their use of 
manipulatives but showed small or no increases in use of other 
demonstration techniques. 



Teachers' Mathematics Tutoring Skills 
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Table 6. Summary of data from the pilot study post course 
participant questionnaire. 



1. I rate my degree of interest in this course as: 



LOW 



0% 


0% 


0% 


24.9% 


75. 1% 


0 


0 


0 


3 


9 



HIGH 



2. I rate the value received from this course as: 



LOW 



0% 


0% 


0% 


8.3% 


91.7% 


0 


0 


0 


1 


11 



HIGH 



3. Specific points which were valuable or significant to me were: 



(1) Individual Tutoring 8 

(2) Programming of Tutoring 6 

(3) Increasing Student Response 4 

(4) Taped Critiques 3 

(5) Actual Practice 2 

(6) Filmed Demonstrations 1 

(7) Manual 1 

(8) Has Utility 1 

4. The course would have been more valuable to me if: 

(1) More initial information on students 4 

(2) More information on math content 3 

(3) No Comment 2 

(4) Wanted Same Student 2 

(5) Change of Students 1 

(6) Wanted Methods Course First 1 

(7) Did Not Like Re-teach Sessions 1 



5. Other comments: 

(1) Liked the Coordination 
v2) Liked the Microteaching 

(3) Liked the Course 

(4) Better as In-Service 

(5) Made Me Un-learn Bad Practices 

(6) Should be used in subjects besides math. 

(7) How can you do private tutoring? 

Students comments following items 3, 4, and 5 were ranked according to 
frequency of occurance. 
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Analysis of Skills Pertaining to Lesson 1 



Results of statistical analyses on prompting and praising 
techniques indicate a significant decrease (p <. 05) in student re- 
sponses to prompting questions between the pre course video tape 
samples and the second post course video tape samples (Table 8). 
This corresponds to the decreases, although not statistically sig- 
nificant, in occurences of prompting questions. Use of general 
verbal praise and declaratives did not increase significantly. How- 
ever, teachers’ use of specific verbal praise did increase signif- 
icantly (p<. 02, p <.001) on both the post videotape samples and the 
second post videotape samples. 



Analysis of Skills Pertaining to Lesson 2 

Although prompting questions comprise a large portion of 
the questioning techniques used in a tutoring sequence, they serve 
mainly to generally elicit student participation. In contrast, diag- 
nostic questions serve more specific purposes. They help the 
teacher and the student to identify areas of misunderstanding in 
instruction and they help the student to verbalize mathematical 
processes. 

Teachers use of diagnostic questions showed the most con- 
sistent increases (Table 9). All five types of questions either ap- 
proached statistical significance (p<. 10) or yielded statistically 
significant differences on both post course videotape samples and 
second post course samples (p <. 05, p<. 001) over pre-course 
samples. Analysis of occurences of type H or "read the problem" 
questions did not reach the specified significance level (p<. 05) on 
the post tape samples but did reach significance (p < 02) on the 
second post tape samples. Virtually all teachers increased their 
use of diagnostic questions as depicted by analyses of total-diag- 
nostic questions. Smallest increases were noted in teachers use 
of questions concerning word definitions. Few verbal problems 
requiring word definitions were used during the tutoring samples. 

Analysis of Skills Pertaining to Lesson 3 

Demonstration techniques are intended to compliment ques- 
tioning techniques and both are viewed as compatible in a tutoring 
sequence. Teachers increases were small for all specific demon- 
stration skills except manipulatives (Table 10). Use of manipula- 
tives increased significantly (p<.05, p<.01) on both post course 
samples and second post course samples. Although increases in 
other specific skill areas were not significant, increases on the 
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Table 8. Analysis of Prompting and Praising Techniques 
Used by Teachers who Participated in Minicourse 5 



t-test for Wilcoxon signed ranks — 
correlated means matched pairs 





t 


T 


N 


D 


Set I 

Prompting questions 


pre- tape/post- tape 


.71 


37 


14 


>.10 


pre-tape/ second post-tape 


-.88 


39 


14 


>.10 


Student Response 


pre- tape/post- tape 


-. 67 


40.5 


14 


>.10 


pre-tape/ second post-tape 


-2. 18 c 


32 


14 


<.05 


General Verbal Praise 


pre-tape/post-tape 


.06 


44 


14 


>.10 


pre- tape/ second post- tape 


. 33 


55 • 


14 


>.10 


Specific Verbal Praise 


pre- tape/ post- tape 


2. 72 d 


0 


10 


<.05 


pre-tape/ second post-tape 


4. 22 f 


0 


13 


<.01 


Declaratives 


pre- tape/post- tape 


.38 


42 


14 


>.10 


pre-tape/ second post-tape 


-.28 


44 


14 


>.10 



a = p <. 20 
b = p <. 10 
c = p<. 05 
d = p< . 02 

e = p<. 01 
f = p < . 001 

, . t ® bove anal yaes (which were obtained from videotape samples of 

14 teachers) were performed, on scorings of occurances of tutoring techniques 
presented in lesson 1. 
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Table 9. Analysis of Diagnostic Questioning. Techniques Used by 
Teachers who Participated in Minicourse 5 

t-test for Wilcoxon signed ranks — 

correlated means matched pairs 





t 


T 


N 


p 


Setn 

Type I- -General Diagnostic 
Questions 

pre-tape/post-tape 


2. 61 c 


2 


8 


<.02 


pre-tape/ second post-tape 


2. 63 e 


5.5 


10 


<.05 


Type H--Read the Problem 
pre-tape/post-tape 


2. 03 b 


14 


10 


<.05 


pre-tape/ second post-tape 


2. 79 d 


13.5 


10 


<.05 


Type ni — Word Definitions 
pre-tape/post-tape 


2. 49 C 


2 


7 


<.05 


pre-tape/ second post-tape 


2. 44 c 


3 


8 


<.05 


Type IV — Renaming, Regrouping, 
Place Value 

pre-tape/post-tape 


2. 45 c 


5 


11 


<.01 


pre-tape/ second post-tape 


2. 44 c 


17.5 


13 


<.10 


Type V— Number Operations 
pre-tape/post-tape 


3. 55° 


0 


9 


<.01 


p re-tape/ second post-tape 


3.09® 


0 


9 


<.01 


Total— Diagnostic Questions 
pre-tape/post-tape 


4. 27* 


7 


13 


<.01 


pre-tape/ second post-tape 


3,79® 


11.5 


14 


<.01 



, X . 5 he above anal y 0e8 ( which were obtained from videotape samples of 
presented^ lessonT^™^ 011 flcorlngs 01 occurance s of tutoring techniques 



a = p<. 20 
b = p<.10 
c = p<. 05 
d = p<. 02 
e = p<.01 
f = p <. 001 
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Table 10. Analysis of Demonstration Techniques Used By Teachers 
Who Participated in Minicourse 5 

t-test for Wilcoxon signed ranks— 
correlated means matched pairs 





t 


T 


N 


p 


Set m 










Estimation 










pre-tape/post- tape 


1. 56 a 




N.C. 


* 


pre- tape/ second post-tape 


1.26 




N.C. 




Expanded Notation 










pre- tape/post- tape 


1.00 




N.C. 




pre- tape/ second post- tape 


1.07 




N.C. 




Number line 










pre- tapc/posi- tape 


1.26 




N.C. 




pre- tape/ second post-tape 


1.00 




N.C. 




Manipulatives 










pre-tape/post-tape 


2. 53 C 


3 


8 


<. 05 


pre-tape/ second post-tape 


3. 50 e 


10 


11 


<.05 


Diagram /Picture 










pre- tape/post- tape 


1. 72 a 


9 


7 


>.10 


pre-tape/ second post- tape 


1. 40 a 


8 


6 


>.10 


Number Sentence 










p re-tape/post-tape 


1. 40 a 




N.C. 




pre- tape/ second post-tape 


2. 38 C 




N.C. 




Total 










pre- tape/post- tape 


3. 47 e 


4 


13 


<.01 


pre- tape/ sec and post- tape 


3. 63 e 


3 


12 


•<.01 


Evaluation 










pre-tape/post-tape 


1.26 


6 


8 


>.10 


pre-tape/ second post- tape 


1. 39 a 


6 


7 


>.10 




5Z 



/ 



Table 10. Continued 
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Practice 



pre-tape/post-tape 


1 . 77 b 


N.C. 


pre-tape/ second post-tape 


1. 81 b 


N.C. 


Total — Evaluation and Practice 


pre-tape/post-tape 


1. 89 b 


N.C. 


p re- tape/ second post- tape 


1.02 


N.C. 



* N.C. = Total number of difference scores was too small to permit computation 

a = p<.20 
b = p <. 10 
c = p<.05 
d = p <. 02 
e = p <.01 
f = p<.001 

Theabove analyses (which were obtained from videotape samples of 
14 teachers) were performed on scorings of occurances of tutoring technioues 
presented in lessons 3 and 4. 
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total of all demonstration techniques combined were statistically 
significant (p .01). 



Analysis of Skills Pertaining to Lesson 4 

Evaluation and practice problems are usually assigned at 
the end of a tutoring sequence following application of questioning 
and demonstration techniques. These techniques should be applic- 
able to all types of mathematical problems. Teachers did not in- 
crease significantly in their use of evaluation techniques, practice 
techniques, or the total of both (Table 10). Five teachers increased 
their use of evaluation techniques and two teachers increased their 
use of practice techniques. 



Analysis of Skills Pertaining to Lesson 5 

Lesson 5 was concerned with techniques for organizing 
teachers’ classes to allow for increased tutoring time. Observa- 
tions in the teachers’ classrooms would have yielded the most 
pertinent data to this topic but that was beyond the scope of this 
study. The effect of observers entering a classroom s; 'cificallv 
to observe mathematics instruction would have been a pocent source 
of experimenter contamination which could have negated results. 
However, teachers did complete a questionnaire (Appendix I) in 
which they provided estimates of average daily tutoring time in 
number of minutes for September and for April. Mean time esti- 
mate increase between September and April for the experimental 
group was +12. 93 minutes and for the control group wa.s —4. 50 
minutes. 



Discussion of Results on Mathematics 
Tutoring Skills 

Teachers’ use of prompting questions and corresponding stu- 
dent responses to these questions represent more than three times 
the number of 00010:60068 of all other techniques combined on the 
pre course samples (62. 04 and 62. 89). This initial high rate may 
be close to an optimal level of prompting questions for a 20 minute 
tutoring session. Another explanation for the lack of improvement 
in prompting techniques and for the significant decrease in student 
responses can be found in the instructional content of the tutoring 
sessions. Teachers who scored highest in use of prompting ques- 
tions on the pre course samples used mathematics facts flash cards 
which required short student responses and could be presented at a 
rapid rate. These same teachers used more advanced instructional 
topics for the post course tutoring sessions. These advanced topics 
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required more time for students to complete a response and prob- 
lems could not be presented as rapidly as mathematics facts. The 
topics dealt with place value and three place multiplication. Prompt- 
ing questions were not scored in the main field test of Minicourse 
5 (Borg, et al, 1970). 

The number of verbal praise techniques used by teachers 
did not increase significantly. However, teachers changed the types 
of praise toward praising the task more instead of simply praising 
good work. This is represented by the significant increase in use 
of specific verbal praise. Teachers were initially praising at a 
relatively high rate (21. 71) and the lack of significant increases in 
this area may again have been due to the increased task completion 
time between pre-course and post-course tutoring samples. The 
pre-course mean score for general verbal praise questions used in 
the main field test (Borg, et al, 1970) was 6. 86 which is consider- 
ably lower than the mean pre-course score derived in this study. 

A question for further research is whether the teachers in this 
sample were unique in their use of prompting and praising tech- 
niques or whether most teachers of special education classes 
utilize prompting and praising techniques more frequently than 
regular class teachers. 

While gaining information on the characteristics of the teach- 
ers used for the present study, it was noted that special education 
teachers in the Salt Lake City District had participated in district 
sponsored workshops in behavior modification techniques and univer- 
sity courses which emphasized the use of reinforcement (Davies, 
1971). This factor may also account for the initially high occurence 
of praising and prompting techniques. Furthermore, teachers who 
are training in behavior modification techniques are often exposed 
to principles of reinforcement scheduling which requires that one 
obtain more responses or more time responding by a student before 
a reinforcement is delivered. Thus, progressively fewer verbal 
praises could be expected during the tutoring sessions. In view of 
an average occurence of more than 62 prompts and 21 verbal praises 
and the increasing amount of time students were requiring to com- 
plete more advanced problems, it may not have been feasible for 
teachers to include more prompts or praises in the tutoring sessions 
These factors do not suggest that providing instruction in praising 
and prompting techniques is not effective with special education 
teachers. Many teachers still lack competency in this important 
management skill. 



Teachers' use of declaratives such as "Mary, six times 
four is twenty-four" did not increase or decrease significantly. It 
was initially contended by this experimenter that the use of declar- 
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atives would decrease as the use of prompting questions increased. 
Since the use of prompting questions did not increase, this conten- 
tion remains to be tested. 

Consistent and progressive increases in use of diagnostic 
questioning techniques were noted. Not only were these increases 
evident between pre-course and post-course samples, but teachers 
continued to improve throughout the year. Questions which promp- 
ted children to verbalize computational processes showed the most 
significant increases. This result is consistent with the results ob- 
tained in the main field study (Borg, et al, 1970). 

Demonstration techniques, which involved a variety of ac- 
tivities such as estimating answers, using number lines and num- 
ber sentences, manipulating materials for computation, and drawing 
pictures or diagrams of mathematical problems indicated only minor 
increases in their use by teachers. Only the use of manipulatives 
showed progressively more significant increases. The total of all 
demonstration techniques combined showed significant increases 
which may be due to the effects of increases in use of manipulatives. 
Again, examination of the instructional content of the tutoring ses- 
sions provides some explanation for the paucity of results in this 
area. Use of estimation, expanded notation, number sentences, 
diagrams, and pictures are most often used in conjunction with 
verbal problems in the Minicourse 5 model lesson films and are 
not usually associated with basic counting and mathematics facts 
levels of instruction in their tutoring sessions. However, the use 
of number lines is applicable to the counting and mathematics facts 
level. No explanation is evident for the teachers’ failure to increase 
their use of number lines. Of interest at this point would be informa- 
tion concerning whether techniques such as use of estimation, num- 
ber lines, number sentences, and expanded notation would be 
applicable with special education children who are working on more 
advanced levels of mathematics. 

Few teachers increased in their assignment of evaluation or 
practice problems to students between pre-course and post-course 
tutoring sessions. Although an entire lesson in the Minicourse 5 
package was devoted to instruction in assignment and use of evalu- 
ation and practice problems, teachers apparently saw little value in 
their use in a tutoring situation. The results of the Far West Lab- 
oratory’s main field test on Minicourse 5 (Borg, et al, 1970) indi- 
cated little change in teachers assignment of evaluation problems 
but did find significant increases in teachers’ assignment of prac- 
tice problems. Informal observation suggests that teachers of 
special education classes schedule individual seat- work activities 
regularly. Therefore, the opportunity to utilize practice assign- 
ments is as present in these classes as it is in regular classes. 
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Both a parametric statistical test (t-test for correlated 
means) and a non-parametric test (Wilcoxon matched-pairs, 
signed-ranks test) were used to analyze the teacher mathematics 
tutoring scores (Tables 8, 9, 10). In asking whether the results 
on a particular skill met or exceeded the specified significance 
level (. 05), both tests agreed on 39 of the 42 analyses. Therefore, 
results of the t-test for correlated means were used in this discus- 
sion supported by the results of the Wilcoxon signed ranks test. 
Results which reached statistical significance via the t-test were 
not reported as significant if they did not reach statistical signi- 
ficance via the Wilcoxon test. 

The results of analyses on teachers’ mathematics tutoring 
skills supported Hypotheses 1 and 2 on selected skills. The hy- 
pothesized increases in frequencies on prompting questions, on 
some demonstration skills, and on evaluation and practice tech- 
niques were not supported by the results. Hypothesized increases 
in verbal praise, diagnostic questioning techniques, and some types 
of demonstration techniques were supported by the results. 



Students’ Mathematics Performance 



Class Means for Mathematics Performance 

Students in the control group performed higher than students 
in the experimental group on all pre -experiment tests administered 
(Table 11). This pre-test difference ranged from . 29 grade level 
on the Wide Range Achievene nt Test to 7. 76 points on the total of 
the four parts of the content referenced test. Mean performance of 
students in the experimental group was higher than mean performances 
of students in the control group on all post-experiment tests. This 
mean difference ranged from . 16 grade level on the Wide Range 
Achievement Test to 12. 73 points difference on the totals of the 
four parts of the content referenced test. 

Student Performance on the Wide 
Range Achievement Test 

Results of the analysis of covariance on raw post test scores 
of the WRAT indicated a significant difference (p<. 005) between 
experimental and control groups in favor of the experimental group 
(Table 12). Marked adjustments in the post test means occured as a 
result of the initial differences in pre test scores (Table 11). 

Similarly, the analysis on the post-test grade level means 
yielded significant differences in favor of the experimental group 
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The above figures were derived from scorings of individual performances on the WRAT and 
Content Referenced Test which were totaled for each class and divided by the number of students in 
the class 
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Table 12. Analyses of co-variance for student performance on the Wide 
Range Achievement Test, Mathematics Section, and on the 
Mathematics Content Referenced Test. 



Test 


Source 


D/f 


Mean Square 


F 


WRAT— Raw Score 


between 


1 


47.285 


12. 40 e 




within 


22 


3.813 




WRAT- Grade Level 


between 


1 


107.121 


9. 42 d 




within 


22 


11. 366 




Content— Part I 


between 


1 


23.270 


7.23° 




within 


22 


3.219 




Content— Part n 


between 


1 


201. 358 


13. 91 e 




within 


22 


14. 479 




Content— Part in 


between 


1 


427.292 


9.73° 




within 


22 


43.93 




Content— Part IV 


between 


1 


4.851 ■ 


3. 54 a 




within 


22 


1.369 




Content— Total 


between 


1 


2225. 369 


26. 99 f 




within 


22 


82. 442 





a = p<.10 
b = p<. 05 
c = p<.025 
d = p<.01 
e = p<.005 
f = p<.001 
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(p<. 01). Large adjustments were also made in post test scores as 
a result of the co variate. 



Student Performance on the Mathematics 
Content Referenced Test 



Although the mean differences between post test scores of 
experimental and control groups were small and the covariate made 
only slight adjustments to the post test means, the difference on 
Part I of the content referenced test was significant (p<.025) in 
favor of the experimental group (Table 12). The uniform increases 
in the experimental group provided a greater homogeneity of vari- 
ance in this group. 

Part II of the test, which deals primarily with testing math- 
ematical concepts, provided the greatest degree of difference be- 
tween the groups (p<. 005) again in favor of the experimental group 
(Table 12). This difference was due in large part to the adjustment 
effect of the covariate. 

Significant differences occured (p<. 005) between perform- 
ances of students in the experimental group over performance of 
students in the control group on Part m of the test (Table 12). Only 
small adjustments were made on the means due to the covariate. 

Differences in student performance on Part IV of the test 
did not reach the specified significance level of . 05 (p<. 10) in 
spite of a major adjustment due to the covariate (Table 12). Many 
classes in both groups obtained mean scores of 0. 00 on this test, 
yielding decreased variability. 

Overall performance of students on the four test parts com- 
bined reflected the pattern of performance on the individual test 
parts. A difference in favor of the experimental group (p<. 001) re- 
sulted with the covariate providing large adjustments to the post 
test means (Table 12). 

Discussion of Results on Students * 

Mathematics Performance 



Significant mean differences on the Wide Range Achievement 
Test were not expected because of a purported tendency for stand- 
ardized tests to lack sensitivity when used with subjects who have 
educational deficiencies (Cronbach, 1960). However, the procedure 
of using intact classes as the unit of observation tended to lessen 
the variability often found in standardized test results and heighten 
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the sensitivity of the statistic toward detecting significant 'differences 
between means. 

Students’ mean increases in grade level, although statistically 
significant, do not appear impressive when compared to increases ex- 
pected in regular classes. Kirk (1960) reported that an average in- 
crease of . 65 grade level could be optimally expected for children in 
classes for educable mentally retarded over a period of nine months. 
The . 50 grade level increase for experimental group students over 
a seven month period meets or exceeds this expectation. A com- 
parison between increases in experimental group students (. 50 grade 
level) and increases in control group students (. 05 grade level) show 
a difference which is ten times greater in the experimental group. 

This difference, paired with differences in increases on Parts II 
(6. 38 for the experimental group, . 49 for the control group) and HI 
(11.28 for the experimental group, 1.95 for the control group) and 
on the total (19. 92 for the experimental group, . 43 for the control 
group) of the content referenced test, lend support to the practical 
significance of the results. 

The high content validity of the content referenced test, 
which was discussed in the first section of this chapter, most prob- 
ably accounted for the consistent effects of the treatment which are 
evidenced in the performance of students in the experimental group. 
Improvements in student performance on computational processes 
and concepts correspond with areas of teacher instruction in Mini- 
course 5. This correspondence will be discussed further in the 
final discussion section of this chapter. 

Results of analyses of student performance on the Wide Range 
Achievement Test and on the Mathematics Content Referenced Test 
strongly support Hypothesis 3 in that differences did occur in the 
direction of greater improvement by students in the experimental 
group over students in the control group. These differences are 
consistent over the subtests. 



Teachers’ Evaluations of Minicourse 5 



Ongoing Course Evaluations 

Following each Minicourse 5 lesson, teachers evaluated the 
applicability to their instruction of each specific technique presented 
in the lesson, using a five point scale (1 being not applicable, 5 be- 
ing very applicable). Table 13 represents a summary of these on- 
going evaluations. The number of teachers who responded to each 
lesson evaluation questionnaire ranged from seven to fourteen. All 
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Table 13. Matrix representing teacher’s evaluations of the appropriateness of 
Minicourse 5 tutoring techniques. 



Low High 

1 2 3 4 5 3-5 



LESSON 1 

General Verbal Praise 
Specific Verbal Praise 
Prompting Techniques 






3 

21% 

2 

20% 

2 

15% 


2 

15% 

3 

30% 

3 

21% 


9 

64% 

5 

50% 

9 

64% 


14 

100% 

10 

100% 

14 

100% 


LESSON 2 














General Diagnostic Questions 






2 


3 


5 


10 








20% 


30% 


50% 


100% 


Number Operation Questions 






4 


3 


3 


10 








40% 


30% 


30% 


100% 


Verbal Reasoning Problem 






3 


2 


5 


10 


Questions 






30% 


20% 


50% 


100% 


LESSON 3 














Estimation 


1 


2 


1 


3 


4 


8 




9% 


18% 


9% 


27% 


37% 


72% 


Expanded Notation, Number 


1 


1 






9 


9 


Line, Manipulatives 


9% 


9% 






82% 


82% 


Drawing a Picture or Diagram 




1 


1 


3 


6 


10 






9% 


9% 


27% 


55% 


J 91% 


LESSON 4 














Evaluation 


1 




1 


3 


5 


9 




10% 




10% 


30% 


50% 


90% 


Practice 


1 








9 


9 




10% 








90% 


90% 


Generalizing The Tutoring 


1 




5 




4 


9 


Sequence 


10% 




50% 




40% 


90% 


LESSON 5 














All Techniques 








2 


5 


7 










31% 


69% 


100% 
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responding teachers rated the Lesson 1 techniques between three 
and five on the five point scale, with prompting techniques receiv- 
ing the highest rating. All responding teachers rated the Lesson 
2 techniques between three and five, with general diagnostic ques- 
tions receiving the highest rating. Three teachers rated estima- 
tion techniques of Lesson 3 on the lower portion of the five point 
scale, two teachers rated expanded notation, number lines, man- 
ipulates on the lower portion of the scale, and one teacher rated 
picture and diagram drawing techniques on the lower portion of the 
scale. Ninety percent of the responding teachers rated evaluation, 
practice, and generalized tutoring sequence on the upper three 
levels of the scale. All responding teachers rated the techniques 
of Lesson 5 on the upper two levels of the scale. 



Post-Course Evaluations 

Following completion of Minicourse 5, teachers again evalu- 
ated the tutoring techniques, but on a three point scale (Table 14). 
Results of this evaluation generally corresponded to the results of 
the ongoing course evaluations with the exception that the techniques 
of Lesson 3 were rated consistently lower on the post course evalu- 
ation. 



Other Minicourse 5 components were also rated on the post 
course evaluation (Table 14). Ninety-two percent of responding 
teachers rated the instruction and model films on the upper two 
levels of the three point scale. All rated the microteach sessions 
on the upper two levels of the scale, but only 83 percent of the 
teachers rated the re-teach sessions on the upper two levels. The 
audio-tape critique and re-critique components were rated on the 
upper two levels by all teachers. 

Discussion of Teachers* Evaluations 
of Minicourse 5 



Teachers’ ratings of Minicourse 5 were consistently high on 
almost all components. Techniques such as estimating answers, us- 
ing number sentences and expanded notation, which are usually assoc- 
iated with advanced levels of mathematics, were not rated as highly 
as praising and prompting techniques and diagnostic questions. All 
instructional components of Minicourse 5 were rated highly except 
for the re-teach sessions. Several teachers questioned the value of 
reteaching the same lesson. It is interesting to note that evaluation 
and practice techniques received high ratings on the teachers’ evalu- 
ations but that teachers did not show a corresponding degree of ap- 
plication in the videotaped tutoring sessions. 
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Table 14. Teacher’s post course ratings of Minicourse 5 tutoring techniques 
according to applicability. 





Low 

1 


2 


High 

3 


General Verbal Praise 






10 








100% 


Specific Verbal Praise 






13 








100% 


Prompting 






13 








100% 


Diagnostic Questions 






13 








100% 


Regrouping, Place 


3 


4 


6 


Value, Renaming 


23% 


31% 


46% 


Expanded Notation 


5 


2 


5 




42% 


16% 


42% 


Number Line 


2 


2 


8 




16% 


16% 


68% 


Evaluation 




1 


11 






8% 


92% 


Practice 






13 








100% 


Manipulatives 


1 




12 




7% 




93% 


Instruction Films 


1 


5 


7 




8% 


38% 


54% 


Model Films 


1 


5 


7 




8% 


38% 


54% 


Microteach Sessions 




6 


7 






46% 


54% 


Re-teach Sessions 


2 


8 


2 




17% 


66% 


17% 


Audio Tape Critique 




6 


6 






50% 


50% 
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Overview of Results 



This chapter has presented findings on teachers’ mathemat- 
ics tutoring behavior, students' mathematics performance, and 
teachers' evaluations of Minicourse 5. The relationship between 
these results and previous research is discussed in the following 
section. 



Correspondence to Literature 
Reviewed on Minicourse 5 



Microteaching, the practice and evaluation component of 
Minicourse 5, has as its basic support, research on applications 
in pre-service situation. Research on its application with in- 
service teachers has been, at best, tenuous (Robinson, 1971). In 
contrast with previous results on microteaching and inservice 
training, the research on minicourses, including the present study, 
strongly supports microteaching both for practice and for self 
evaluation. With the exception of one study which found no signif- 
icant effects on student behavior as a result of teachers participa- 
tion in microteaching (Robinson, 1971), microteaching has been 
proven successful only in that it changes teacher behavior. Al- 
though the changes in student mathematics performance in the 
present study are the results of teacher participation in minicourse 
instruction, the utility of microteaching is also reflected in these 
results. The assertions of Meier (1968), Schutte (1971), and Allan 
and Ryan (1969) concerning the value of microteaching as a self- 
evaluation technique are vindicated by the results of the present 
study. Teachers rated the audio tape critique highly and indicated 
that they preferred to evaluate their own performance. 

Minicourse 5 had earlier been found to be a valid training 
package for teachers of regular elementary classes (Borg, et al, 
1970). This study found it to also have validity for special educ- 
ation teachers. The most impressive changes in teacher behavior 
in the initial field test were noted pertaining to diagnostic question- 
ing techniques. The greatest increases in teacher behavior in the 
present experiment were also in use of diagnostic questions. Un- 
like the increases in application across the entire range of tutoring 
techniques shown by teachers in the initial field test, teachers in 
the present experiment displayed increases on selected techniques. 

The most significant contrast between the developmental 
field tests of minicourses and the present experiment is that 
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minicourses were initially validated only in reference to changes 
in teacher behavior whereas validity in the present experiment in- 
cluded changes in student performance. 



Teachers* Tutoring Skills Compared to 
Students* Mathematics Performance 



The effects of Minicourse 5 were realized both in changes 
in teachers* tutoring behavior and in improvements in the perfor- 
mance of their students. Results are selected in reference to 
teachers but consistent in reference to students. Two areas of 
correspondence are evident. Greatest increases in teachers’ use 
of tutoring skills can be seen where techniques applying to mathe- 
matical concepts and processes were emphasized (diagnostic ques- 
tions). The most impressive improvement in student performance 
was found in items which tested knowledge of concepts and processes 
(Content Referenced Test, Part IV). This correspondence may 
support a contention that some techniques of Minicourse 5 are not 
content free to the extent that an advanced level of mathematics 
performance must be attained before the techniques become appli- 
cable. 



Teacher Tutoring Skills Compared to 
Teachers* Evaluations of Minicourse 5 



A poor correspondence existed between the lack of change 
in teachers* application of praising and prompting techniques and 
the high ratings by teachers of these same techniques. However, 
when teachers* pre-course use of these techniques was compared 
to their ratings of the techniques, a correspondence was evident. 
Teachers mean pre course use of prompting questions and verbal 
praise was 62. 04 and 21. 71 respectively. This lends support to a 
contention that teachers were already using these techniques at a 
high rate. 

Teachers also increased their use of those skills which they 
rated most highly (diagnostic questions) with the exception of evalu- 
ation and practice techniques. No rationale for the lack of corres- 
pondence on evaluation and practice techniques is evident from 
inspection of the data. The correspondence on use of demonstra- 
tion techniques was mixed and showed no definite pattern. 

The results presented in this chapter indicate definite 
changes in teachers* tutoring behavior and definite improvement 
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in students' mathematics performance as a result of teachers' 
participation in Minicourse 5. 

Factors which may be unique to the teachers in this study 
and which may have influenced the results include previous training 
in similar techniques (behavior modification), a level of instruc- 
tional content which differed from the range intended for complete 
use of Minicourse 5 techniques, and the progression of students to 
more advanced mathematical operations between tutoring sessions. 
The previous training was shown to have an influence on use of 
praising and prompting techniques which may not be generalized to 
teachers who have not had similar previous training. The level of 
instructional content of other special education classes may range 
to higher levels than that which was demonstrated by teachers in 
the present study. Thus, utilization of more of the demonstration 
techniques may be possible. The progression of students to higher 
curricular levels may warrant a more sophisticated scoring system 
for samples of tutoring behavior to compensate for ratio changes 
between appropriate student behavior and teachers' use of praising 
and prompting techniques. 

The discussion of agreement between teachers' use of cer- 
tain tutoring techniques and students' improvement in mathematics 
performance noted a result which is consistent throughout the data. 
Teachers did not increase their use of all of the techniques presented 
in Minicourse 5. However, they did assimilate into their instruc- 
tion those techniques which were most responsible for bringing 
about changes in their students. In spite of the teachers' lack of 
adoption of most demonstration, practice and evaluation techniques, 
their students made large and generalized improvement in mathe- 
matics performance. Those techniques which were adopted may 
account for this improvement. 



Attainment of Minicourse 5 Objectives 

The two major objectives present in Minicourse 5 which 
might be responsible for changes in student mathematics achieve- 
ment are increases in tutoring time and increases in teacher skills. 
The relative importance of both of these objectives on the inter- 
action (if any) cannot be deduced by the results of this study. It 
would appear that both of these objectives were operating to some 
extent. The experimental teachers reported that they increased 
their tutoring time while the control group reported a decrease in 
tutoring time. There is some evidence to suggest that the increase 
in teacher skills was also responsible for some of the increase in 
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student achievement. This evidence is provided by the concurrent 
increases in teacher skill in conceptual areas and the student im- 
provement in mathematics achievement areas. Any attempt to use 
the data from this study to develop conclusions on the relative im- 
portance of improvement in teacher skills and increased tutoring 
time would be unwise. Such an undertaking would, however, be a 
profitable area of investigation because the finding would be useful 
in increasing the efficiency of the present program as well as guid- 
ing the development of future minicourses. 
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SUMMARY, CONCLUSIONS, AND 
RECOMMENDATIONS 



Summary 



Traditional procedures for inservice training of teachers 
in special education have lacked systematic or definitive tests of 
validity. Often these procedures do not permit replication and do 
not permit participants to try out the teaching techniques presented 
during the training. 

Minicourses are training programs utilizing instructional and 
model films which present specific teaching techniques and strategies 
and which provide ongoing practice experiences for course partici- 
pants. These courses have been successfully field tested with teach- 
ers in regular classes but they have not been tested with teachers in 
special education. Nor have they been tested to determine whether 
students will improve in academic performance as a result of their 
teacher’s participation in Minicourse instruction. 

Micro- teaching, the basic practice component of the minicourse, 
has been proven successful in improving teaching behavior in both pre- 
service (Aubertine, 1964; Allen & Fortune, 1964) and in-service 
(Borg, et al, 1970) settings. Minicourses utilize an entire microteach, 
critique, reteach, re-critique sequence following each filmed lesson. 
Microteaching provides the controlled practice which is necessary to 
effectively utilize minicourse instruction. 

Minicourse 5, which comprised the treatment component of 
this experiment, provides instruction in mathematics tutoring tech- 
niques. Twenty-five teachers of educable mentally retarded children 
participated in an evaluation of the utility of Minicourse 5 for special 
education. Fifteen of these teachers received Minicourse 5 instruction 
while the remaining ten teachers served as a control group. Video- 
tape samples of teachers' mathematics tutoring behavior were collect- 
ed before they participated in Minicourse 5, immediately following 
their completion of the course, and after a delay period of five months. 
Students of both experimental and control group teachers were admin- 
istered tests of mathematics performance before their teachers re- 
ceived Minicourse 5 instruction and W6re retested five months after 
the teachers completed the course. 
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Results of statistical analyses performed on teacher’s math- 
ematics tutoring behavior indicated increases in their use of diag- 
nostic questioning techniques and little or no change in their use of 
some prompting, praising, demonstration, evaluation, and practice 
techniques. The level of instructional content and the degree of 
previous use of some techniques which were presented in Minicourse 
5 were suggested as partial explanations for the teachers’ failure 
to increase their use of some techniques. 

Results of statistical analyses performed on tests of stu- 
dent's mathematics performances showed statistically significant 
increases in favor of the experimental group over the control group, 
particularly on items which tested student's knowledge of mathemat- 
ical concepts and processes. A correspondence exists between 
teachers' improvement in use of techniques which foster mathemat- 
ical conceptualization. 



Conclusions 



In general, the data support the utility of Minicourse 5 as 
an inservice training tool for improving mathematics tutoring skills 
of special education teachers. Results support the effectiveness of 
Minicourse 5 as a teacher training device not only for changing 
teacher behavior but for improving the mathematical achievement 
of their students. 



Tutoring Areas in Which Teachers 
Did Not Improve 

Those areas of Minicourse 5 instruction which did not pro- 
mote positive changes in teacher behavior must be discussed in 
relation to other influencing variables. 

1. Teachers were using prompting questions and general 
verbal praise at a relatively high rate before receiv- 
ing Minicourse 5 instruction. The mean pre course 
occurence of prompting questions was 62. 04 and of 
general verbal praise was 21. 31. Many of the teach- 
ers had participated in one or more behavior modif- 
ication workshops in the past. These workshops 
placed strong emphasis on reinforcement techniques 
and on techniques which promoted increased student 
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response rates (Davies, 1971) and may have been 
the reason for the initially high rate of performance. 
This initially high rate of use of prompting and prais- 
ing techniques left little margin for improvement in 
a twenty minute session. 

2. The complexity of mathematical problems used in 
the tutoring sessions increased between precourse 
and post course videotapings. Students required 
more time to complete problems which contained 
several steps, thus decreasing the number of in- 
stances in a twenty minute session that allowed 
teachers to provide verbal praise. In addition, the 
ratio of student performance to reinforcement would 
be expected to increase if the use of reinforcers is 
to reach optimal efficiency thereby lengthening the 
duration between reinforcement. 

3. The level of concepts being taught by the teachers 
was not sufficiently advanced to allow many of the 
demonstration items to be put to best use. While 
many teachers could utilize manipulative s and num- 
ber lines at all levels of instruction, techniques such 
as estimating answers, employing expanded notation, 
number sentences, and drawing diagrams or pictures 
of problems, are most often associated with story 
problems and problems which require several dif- 
fering mathematical operations. The majority of 
the instructional content sampled by videotape in- 
volved counting, number sequencing and single 
operation problems. 

In light of the factors described above, the results do not 
suggest that teachers who aren’t initially using prompting and 
praising techniques will not improve in use of these techniques. 

The results do suggest, however, that teachers who are already 
consistently using these techniques will not improve. One may 
also conclude that some techniques presented in Minicourse 5 are 
not entirely independent of curriculum level. Several demonstration 
techniques are more pertinent to levels of mathematics concept 

which are beyond those being taught by the teachers who participated 
in this experiment. 
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Teacher's Adoption of Pertinent Techniques 

It is apparent that certain techniques presented in Mini- 
course 5 are particularly important in affecting student perform- 
ance. Those questioning techniques which promote student 
verbalization of number operation, processes, and concepts are 
supported by the high correspondence between teachers' increases 
in utilization of the techniques and their students' improvement in 
related mathematics performance. 

Although a significant increase in use of praising techniques 
did not occur, a shift in type of praising did occur. Teachers in- 
creased their use of specific verbal praise which tends to direct 
the student' s behavior toward more rapid solution of similar prob- 
lems or toward more consistent application of a technique that 
was praised. Again the teachers' adoption of this technique may 
have assisted in their students' improved performance in problem 
solving and conceptualizing skills. 

Among the demonstration techniques presented in Mini- 
course 5, the technique which is most singularly useful at all 
levels of mathematics instruction, use of manipulative s, was con- 
sistently adopted by the majority of teachers. ' Manipulatives were 
used by teachers on levels of basic counting and on multiple oper- 
ation problems. It is curious that teachers did not consistently 
apply the number line technique in the tutoring sessions since num- 
ber lines can be helpful for beginning levels ox instruction. Through 
casual observation it was noted that facsimiles of number lines 
were drawn on blackboards fastened to student's desks or placed at 
various locations in the rooms of many of the participating teachers. 

No explanation is evident for the teachers' failure to assign 
evaluation or practice problems. Applicability of these techniques 
should be independent of instructional content or method. 

A general conclusion is evident from examination of both 
the teachers' mathematics tutoring behavior and the students' 
mathematics performance. Teachers tended to adopt those tech- 
niques which were most applicable to their instructional situation. 
Although they did not utilize all of the techniques presented in Mini- 
course 5, they did apparently include in their instruction those 
techniques which would bring about significant improvement in 
their students. 
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Recommendations 



The validity of Minicourse 5 as an inservice training pack- 
age for special education teachers has been supported. The course 
is of benefit to teachers as it is now produced. The following 
course administration recommendations are presented to facili- 
tate utilization: 

1. Teachers should be provided release time of one 
hour per day while the course is in progress. 

There is less tendency to overlook critique and 
re-teach sessions when time is specifically al- 
lotted for these functions. 

2. University sanctioned course credit should be pro- 
vided, along with a completion contingency such as 
written evaluations of each lesson or some evidence 
of having conducted the microteach sessions. Nine 
of the fourteen teachers who completed Minicourse 
5 stated that they would have preferred a comple- 
tion contingency of this ns.ture. 

3. A small group of teachers (5-10) should be assem- 
bled to take the course together rather than having 
each teacher take the course as an individual ef- 
fort. 

4. The suggested course schedule should be lengthened 
to approximately five weeks from the presently sug- 
gested 4 weeks. 



Future Research on Minicourses in 
Special Education - 

All instructional components of the Minicourse 5 package 
were found to be of value. Some of the tutoring techniques were 
apparently not useful to the teachers who participated in this pro- 
ject. Further investigation should be carried out to determine 
whether these techniques are applicable by other special education 
teachers. 

As the target population for this experiment was described, 
the results are directly generalizable only to teachers of educable 
mentally retarded children in the Salt Lake City School District. 
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However, it is expected that teachers with similar instructional 
goals and similar previous training could benefit from Minicourse 
5 instruction. Since a present trend in special education is toward 
discouraging categorization of teachers and students, it is of no 
apparent benefit to suggest further field testing of Minicourse 5 
in each of the categories. This experiment has demonstrated that 
Minicourse 5 is effective in improving tutoring behavior of teachers 
who are working at the most basic levels of mathematics instruc- 
tion. Paired with the results of the initial field tests of Minicourse 
5 (Borg, et al, 1970), it is evident that the course is valid across 
a broad range of early mathematics instruction. An efficacious 
area of inquiry would be the inclusion of techniques which could 
supplement Minicourse 5 as a training tool in the remediation or 
prevention of mathematics deficiencies of all children. 



Improvement of teacher's tutoring skills can significantly 
aid the remediation process in mathematics. Investigation must 
be undertaken to determine whether these tutoring skills are gen- 
eralizable to other subject areas and whether minicourse instruc- 
tion in other subject areas has utility in remedial situation. 



Improvement in Data Collection Procedures 

Further examination of data collection procedures is a 
requisite for future research on minicourses. More precise 
scoring techniques to equate the level of teachers' prompting and 
praising techniques with the level of student performance on video- 
tape samples must be developed. Data are lost when simple freq- 
uency counts of behavioral occurences are examined in isolation 
from each other and their interrelationships are not considered. 
Precision teaching specialists such as Lindsley (1959) have devised 
behavioral observation techniques which might be adapted to the 
scoring of videotape teaching samples. 

utilization of testing pr ocedures which are more sensi- 
tive to treatment effects on student behavior must also be encouraged 
Tests which are directly referenced to the content of instruction or 
to instructional objectives must be developed and validated. The 
monitoring of both teachers' instructional behavior and students' 
performance via in-class observation techniques during the treat- 
ment period could provide heightened levels of sensitivity in the 
data collection process. 
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Appendix A 



List of Minicourses; Completed 
and in Development Stages 
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Minicourse One: 
Minicourse Two: 

Minicourse Three: 

Minicourse Four: 
Minicourse Five: 

Minicourse Seven: 
Minicourse Eight: 

Minicourse Nine: 



Effective Questioning in a Classroom 
Discussion 

Thought and Language: Skills for Teach- 
ing the Kindergarten Child with Minimal 
Language Experience 

Effective Questioning in a Classroom 
Discussion (Secondary) 

Verbal Interaction 

Effective Tutoring in Elementary 
School Mathematics 

Induction: An Instructional Technique 

Organizing the Kindergarten for Inde- 
pendent Learning and Small Group 
Instruction 

Thought Questions in the Intermediate 
Grades 



Minicourse Ten: 
Minicourse Fourteen: 

Minicourse Fifteen: 

Classroom Simulation 1: 



Stimulation-Discussion- 
Action 1: 



Role Playing as an Instructional Technique 

Improving Teacher and Pupil Skills in 
Discussing Controversial Issues 

Teaching Skills that Develop Independent 
Learning in the Upper Elementary Years 

Techniques for Evaluating and Solving 
Pupil Disruptions to the Learning 
Environment (Upper Elementary Years) 

Confrontations - A Human Relations 
Training Unit 
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Appendix B 



Minicourse 5: Daily Course Schedule 
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WEEK PRECEDING COURSE 



Receive Course materials. 

Receive orientation to use of audiotape recorder 
(ATR) or videotape recorder (VTR) and 16mm. 
sound projector. 

Read Preface and Chapter 1, Introduction, in Hand- 
book. 



LESSON 1: PRACTICE IN MICROTEACHING 

1 Read Handbook Chapter 2, Individualizing Instruction 

by Tutoring: Research Findings (optional). 

Read Chapter 3, Lesson 1, in Handbook. 

View Instructional and Model films for Lesson 1. 

Day 2 Practice Microteach. 

Select two pupils. 

Set up equipment for recording. 

Re-view Model Film for Lesson 1 (optional). 

Tutor for about twenty minutes. 

Complete microteach self-evaluation forms for 

Lesson 1. 

U 

LESSON 2: DIAGNOSIS IN THE BASIC TUTORING SEQUENCE 

Da V 3 R ead Chapter 4, Lesson 2, in Handbook. 

View Instructional and Model films for Lesson 2. 
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Day 4 Microteach. 

Select two pupils. 

Set up equipment for recording. 

Re-view Model Film for Lesson 2 (optional). 

Tutor for about twenty minutes. 

Complete microteach self-evaluation forms for 

Lesson 2. 

Day 5 Reteach. 

Select two pupils. 

_____ Set up the equipment for recording. 

Re- view Model Film for Lesson 2 (optional) 

Tutor for about twenty minutes. 

Complete reteach self-evaluation forms for Les- 
son 2. 

LESSON 3: DEMONSTRATION TECHNIQUES IN THE BASIC TUTORING 
SEQUENCE 

Da y 6 Read Chapter 5, Lesson 3, in Handbook. 

View Instructional and Model films for Lesson 3. 

Day 7 Microteach. 

Select two pupils. 

Set up equipment for recording. 

Re-view Model Film for Lesson 3 (optional). 

Tutor for about twenty minutes. 

b6 
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Complete microteach self-evaluation forms 

for Lesson 3. 

Day 8 Reteach. 

Select two pupils. 

Set up the equipment for recording. 

Re-view Model Film for Lesson 3 (optional). 

Tutor for about twenty minutes. 

Complete reteach self-evaluation forms for 

Lesson 3. 

LESSON 4: EVALUATION AND PRACTICE IN THE BASIC TUTORING 
SEQUENCE 

Da y 9 Read Chapter 6, Lesson 4, in Handbook. 

View Instructional and Model films for Lesson 4. 

Day 10 Microteach. 

Select two pupils. 

Set up equipment for recording. 

Re-view Model Film for Lesson 4 (optional). 

Tutor for about twenty minutes. 

Complete microteach self-evaluation forms for 

Lesson 4. 

Day 11 Reteach. 

Select two pupils. 

Set up equipment for recording. 
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Re- view Model Film for Lesson 4 (optional). 

Tutor for about twenty minutes. 

Complete reteach self-evaluation forms for 

Lesson 4. 

* 

LESSON 5: ORGANIZING MATHEMATICS INSTRUCTION FOR IN- 
CREASED TUTORING TIME 

Day 12 Read Chapter 7, Lesson 5, in Handbook. 

Day 13 Postcourse meeting with coordinator. 
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Mathematics Content Referenced Test 
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NAME 




RAW A CIRCLE AROUND THE 2. 




RAW A CIRCLE AROUND THE 7. 





THINGS HERE AND DRAW A LINE TO THE CORRECT NUMBER. 







HOW MANY FALLS? 






HOW MANY CANDLES? 



i 







A 



HOW MANY BOXES? 



□ □□□□□□□□ 
□□□□□□an 



HOW MANY DOTS ? 






ADD A QUARTER, A NICKEL, AND A DIME 



^dcke^ ~ 



83 



PUT THE NUMBERS ON THIS CLOCK 
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WHICH IS MORE? 

9 or 5 

6 or 8 
43 or 27 

WHICH IS LESS? 

7 or 4 
34 or 18 




TWO = 
NINE = 
FOUR = 



SEVEN = 
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THREE PENNIES MINUS ONE PENNY 




FOUR PENNIES PLUS TWO PENNIES 




WHAT TIME DOES THIS CLOCK SAY? 




WHAT TIME DOES THIS CLOCK SAY? 
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WHAT TIME DOES THIS CLOCK SAY? 



gg WHAT TIME DOES THIS CLOCK SAY? 










7 



w 



t-t 



1 



PART n 



NAME 
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EMONSTRATION 







j_L 




10 



15 



20 



RAW THIS PROBLEM ON THE NUMBER LINE. 



12 + 6 = 18 




-1 ■ ■ ■ ■ I 

10 15 
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WRITE THE ANSWERS IN THE BOXES. 




436 



452 

-176 



52 




tens 


+ 


ones 


hundreds 


+ 


tens 


+ 


ones 



400 


+ 50 


+ 




+ 


+ 



6 x 


7 = 


6 x 


3 + 


X 


4 x 


9 = 


2 x 


CO 

+ 

1 1 


X 



23 x 46 = 23 x 40 + 



A farmer has 15 chickens 
he buys another 12 chickens 
and then sells 7 chickens 



How many chickens does he have ? 



A man bought a new car for $2, 253. 87 . 
A year later he sold it for $1, 725. 00 . 



How much did he lose on the sale ? 
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A woman paid $5. 00 down f or a coat and 
then paid $6. 85 a month for 15 months. 

What did the coat cost? 

97 



W w V J 



'i 1 



7 









T-T 



NAME 
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part m 



ADD 



3 

+0 


6 

■*i 


9 

+7 


4 

+6 


CO TO j 


3 

46 


1 

+ 1 




7 +2 = 
5 +8 = 


SUBTRACT 
















3 


8 


13 


1 


11 


15 




12 


5 - 3 = 


-1 


-2 


-7 


-0 


-9 


-7 




-3 












- ■■ 


























16 - 8 = 


ADD 


















3 


7 


9 




11 


23 




31 




5 


4 


5 




9 


14 




40 




+1 


♦8 


+7 




+16 


89 




57 














+37 




+75 





MULTIPLY 








7 8 9 

x3 x4 x6 


8 7 

x5 x8 


3 0 

x9 x(> 




DIVIDE 








2 flT 


4/28* 


7/14 


5/1T 



1.69$ 


$2.38 


$4.12 


$32. 59 


i- .36? 


+5. 19 


-1.89 


-9.95 
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fc»— — 






7 



1 



r 






T-r 






89 

ADD 



14 50 

+15 +72 


00 t-l 
eo 


19 49 17 

+12 -»33 +65 


24 87 

+84 +93 




SUBTRACT 








18 24 


96 


74 17 43 


88 65 




“11 “11 


-28 


-50 -11 -37 


-23 -46 




ADD 










432 


112 


527 






+286 


+649 


+768 






SUBTRACT 








176 


354 


648 






-141 


-285 


-269 






MULTIPLY 








18 


24 


76 


476 


568 


x7 


x!6 


x48 


x308 


x265 


DIVIDE 










7/25T 




76/STT 


28/J49* 





O 

ERiC 



NAME 



ADD 



l + i = . 

5 + 5 



SUBTRACT 
5 3 

7T = 



PART IV 



6 

8 




7 2 _ 

IT 




3 FEET 


= 


INCHES 


4 l / 2 FEET 


s 


INCHES 


3 YARDS 


s 


FEET 


5 V 3 YARDS 


s 


FEET 


8 YARDS 


s 


FEET 


12 FEET 


s 


YARDS 


18 FEET 


s 


YARDS 


10 FEET 


s 


YARDS 


14 FEET 


= 


YARDS 


3 HOURS 


= xto 


MINUTES 
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4 V 3 HOURS = 


MINUTES 


120 MINUTES = 


HOURS 


460 MINUTES = 


HOURS 


14 MINUTES 


SECONDS 


360 SECONDS = 


MINUTES 


48 OUNCES 


POUNDS 


8 POUNDS 


OUNCES 


1 GALLON 


QUARTS 


3 QUARTS 


PINTS 



WHITE AS PERCENT 

3 

5 = 

FIND THE AVERAGE 

32 17 31 24 

MULTIPLY 

4. 84 

x22. 6 



WRITE AS A DECIMAL 
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3 

I 



Appendix p 



Wide Range Achievement Test: 
Level I, Arithmetic Section 



l 
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Appendix E 



Scoring Instructions for Videotaped 
Samples of Tutoring Behavior 



10-4 
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O 

ERIC 



MINICOURSE 5 
EVALUATION 

Vour task is to resolve differences of opinion between two judges 

as to whether a teacher has assigned an evaluation problem to a student 
during a mathematics tutoring sequence. 

In a typical tutoring session, a student presents the teacher with 

an example (e.g. divide 4/3 by 1/2) which he cannot solve. Then, the 

teacher diagnoses the source of the student's difficulty. Diagnosis is 

subsequently followed by the teacher explaining ,„d demonstrating how the 

example can be solved. In „ rd er to determine the extent of student 

learning which has taken place, the teacher then assigns the student an 

example (e.g. divide 3/5 by 2/3). simile to the one on which he was having 

difficulty initially, to solve on his own. The word similar is Important. 

If a student is having trouble dividing fractions, asking him to solve 

a problem which requires him to multiply, add, or subtract (but not 

divide) fractions does not really test whether he now understands how to 

divide fractions. Determining whether an example Is sufficiently similar 

to the one which initially caused a student difficulty will probably be 

one of your main tasks in resolving these differences of opinion between 
judges. 

In scoring EVALUATION, score teacher statements that clearly indicate 
the student is to solve a problem on his own. For example, "Let's see 
If you can do this one without help," would be scored. But "Let's see 
if you can do this one," would not be scored. There is an exception to 
this rule. If the teacher assigns the student a problem saying "Now do 
tMs one" (not scorable) and it is apparent that it is a probl™ assigned 
for the purpose of evaluation, -score it. The rule to use here Is that 
the teacher should be quiet at least 30 seconds while the student works 

105 
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on the problem. If the teacher starts talking or asking questions, it 
should not be scored as EVALUATION. 

NOTE: If the teacher praises the child during the 30 seconds but 

does not otherwise interfere with the child, this should still be scored 
as EVALUATION. 

Now, what happens when the teacher says, "Do this one," and the child 
solves it (either correctly or incorrectly) in less than 30 seconds. If 
the teacher has not interfered with the child, score this example as an 
evaluation problem. 

At times, the student comes in with a written problem (e.g. 24 - 8) 
that he can not solve. The teacher goes through the steps of the basic 
tutoring sequence and says, "How much is 33 - 7?" The child then solves 
the problem orally without help from the teacher. Score this as an eval- 
uation example. 

Often, teachers will use a session to help a child learn how to 
solve a variety of examples. Thus, she may first tutor him in multiplication 
of fractions and then in division of fractions. In this case, one would 
hope that the teacher assigns an evaluation example for multiplying fractions 
as well as one for dividing fractions. However, score only the use(s) of 
evaluation which actually occurs on the tape. 

Another example is provided by the Instance in which the teacher lets 
the student assign himself an evaluation example. Score this as evaluation 
if it appears that the student has chosen an example which is similar to 
the one which he initially could not solve. 

Finally, when in doubt as to whether evaluation has occurred or not, 
please give the teacher the benefit of the doubt and tally the situation 
as evaluation. 
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Additional Scoring Rules 

1. Tell raters not to talk to each other. 

2. Have raters read handbook beforehand. 

3. Don't count - What does the problem want you to find out. 

4. Questions in the present tense of the following variety: 

What are you doing now? 

Why are you doing this? 

<sre not counted. 

5. Teacher's requests for the child to do something are not counted as 
diagnostic questions. 

e.g. Will you multiply these two numbers please? 

. 6. Don't count questions which ask the student to read an answer. 



JG 

3/30/70 
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TALLY OCCIJRtNCE OF DIAGNOSTIC QUESTIONS 



Definition uf Diagnostic Questions; 



Diagnostic questions are general questions which test the student's unHor 
standing of concepts and procedures necessary for the solution of a Darticu 

que r ti on form FiJe^vDe^of^?" 5 T** phraSed 1n either stateme "t or 

que.cion torm. Five types of diagnostic questions will be scored 



ft-P? G f n f ral P-jagnosti q Questions . These are broad questions which ask 
the student to verbalize the nature of his P roblem-solvi2 g d.ff?cuHy 



(a) What's wrong? 

What is the problem? 

What part don't you understand? 

Can you tell me what you did? 

What part is giving you difficulty? 

How did you get your answer? 

Tell me what you are doing. 

Do you see what's wrong? 

Are you sure what reducing fractions mean? 
Can you show me what you have done? 



(b) 



Questions of the "How did you?", "What did you?", "Whv did you?" 
and Where did you?' form which deal with specific operations ’ * 

in nno P UJ a Jil 0nS * hlch t ? e student has performed. Questions stated 
Hnnc -S S L f0n !! S should be scored as general diagnostic ques- 
categorles lf th6y d ° n0t clearly fal1 int0 one of th e other q 



e.g. Why did you move your decimal point here? 

How did you divide these numbers? 

Why are you doing that? 

S: I can't do this. T: Why not? 

Why can't you subtract 8 from 7? 

What did you do when you found the lowest cormion 
denominator? 

What did you do next? 

Why did you add? (In nunber operation problems only.) 



Questions which should 
1 . What did you 
value. 



not be scored as general diagnostic questions: 
think the 5 in 51 stood for? Score as place 



2 . 

3. 

4 . 



What did you think was meant by an altimeter? Score as 
word definition. 

Why did you multiply? (In verbal reasoning problem.) 

Score as a question which asks the student to select or 

u> ex I? a 1 1? be selected a particular number operation. 
Why don t you do this now? (Not scored as anything.) 
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uiagnostic Questions Evaluation 

* 01 *. » lead the P ro^. 

e.g. Con you rood the problem for me? 

Rend this number sentence. 

What does inis equation say? 
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N°t e: ion examples, score statements like „„ al cnr 

says b|Zi . Cut do not score the student's reading of his answer 

rend vnur a ntuor " * 



"Read what this 



e.g. "Please rend your answer.". 



^ U !! tinns that testthe st udent's understandin g of word definitions 

e.g. Are there any words you don't understand? a * 

Do you know what a mixed number is? 

What is a simple fraction? 

Can you explain to me what this sign tells us? 

Do you remember what a lowest common denominator is? 

What does that mean, $10.80? 
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uidynoscic Questions tvaluation 



Type 4: Questions that- 

regrouping, re nam i ng . 
examples. ) 



tost the student 's understanding of place val ue , 
(Only for addition, subtraction, and multiplication 



(a) 



(b) 



Plj_ ce vdli.e : ones! ions which require the student to explain 

place value or to demonstrate an understanding of place value, 
e.g. Wiidt is the value of 4 in the numeral 46? 

‘ ,h ^ t does the mineral 3 stand for in 3556? 

Questions such as. How many tens are in 54?" should not be 

of £hP ?!„!■ T Va U ? questi ? ns since they suggest the concepts 
A place value to the child rather than allowing 
him to demonstrate this understanding. y 



Renaming . 

e.g. Can you give me another name for 37? 
What's another way of writing 73? 
Would you rename 51? 



(c) 



I5 e p r? cess !J hlch was formerly called borrowing. 
K d subtraction and consists of the modifications that 
must be performed in order to subtract a larger number from 
a smaller number. 



It 



e.g. Do you understand how to regroup? 

Why can't we subtract these nunbers the way they are’ 

How would you regroup 51 so that we can subtract 28 
from it? 

Regroup 103 so that we can subtract 57 from it. 



Diagnostic Questions Evaluation 
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J^ pe 5; Number Op erations. Questions in which the teacher asks 

sdpH f i r mKnh Dera ^ ° K f Te would use * (The word number operation 
specific number operation must be mentioned in the question.) 



the student 
or a 



(a) What number operation would you use? 
Would you add? 



Do not score general questions of the type: 
What kind of problem is this? 

How do you think we solve this problem? 



(b) Follow-up questions which ask the student to explain why he selected 
a particular number operation. y selectea 

e.g. Why did you say we should add? 

Why are you going to multiply? 



Note: 



i luncfCl f CMtrjf 



Most of these questions occur with verbal problems. 

orariHinn?^ 0 ^ with nuribe f options (e.g. "What's a short fom 
of adding? How can we check our subtraction?") where it is 

necessary for the student to select a particular number operation. 
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Diagnostic Questions Evaluation 



EXAMPLES OF DIAGNOSTIC QUESTIONS: 


Type 1. 


T: 


What's the problem, Mike? 




S: 


I don't understand these examples. 


Type 2. 


T: 


Will you read this first one for me, please? 




S: 


The airplane had flown for three hours at 485 miles an hour. 
How many miles had it flown on that trip? 


Type 3. 


T: 


All right, are there any words that you don't understand? 




S: 


No. 


Type 5. 


T: 


All right, what number operations would you use? 




S: 


Adding. 




T: 


Well, you could do it another way besides addinq. What's 
a short way to do adding? 




S: 


Multiply. 








Type 1 . 


T: 


Where did you get this three? 



ADDITIONAL SCORING RULES 

1. Score the entire tutoring session or up to counter number 200. 
(Whichever comes first.) 

2. If two or more diagnostic questions are asked consecutively, tally 
the question to which the student responds. 

e.g. T: What part don't you understand? Can you read the problem? 

S: [Student reads . . .] 

Tally the second question. 

3. Student need not necessarily answer the diagnostic question for it 
to be scored. The teacher may ask the question, the student can't answer, 
so the teacher needs to ask another question. Score the first question if 
it is diagnostic. 

4. If you are ambivalent about a particular question, score it in 
preference to not scoring it. 




iPfilTsiorfnales s 1 ln°(whf che vej 1 2 °° C0U " t6rs 0r t0 the end 



Tape No. 



FIRST SESSION 



Conten t: (circle one) 

Length : (counter number) 



Number Operation 



Diagnostic Questions 

I General Diagnostic 

II Read the Problem 

III Word Definitions 

IV Place Value, Regrouping, Renaming 

V Select Number Operations (for verbal 

reasoning only) 



Tape Quality (circle one) : 

EiSfor? Parts not visible 

-9 und Parts not audible 



Verbal Problem 



Counter 




Counter 


No. 




No. 


-Q-40 




41-200 







































Poor Good 

Poor Good 



Ambiguous Questions: 
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Procedure: Score diagnostic questions for the first 200 counters or to the end 

of the tutoring session (whichever comes first). 

Tape No. 

SECOND SESSION 

Content (circle one): Number Operation Verbal Problem 

Length (counter number) : 



Diagnostic Questions 

I General Diagnostic 

II Read the Problem 

III Word Definitions 

IV Place Value, Regrouping, Renaming 

V Select Number Operations (for verbal 
reasoning only) 

Tape Quality (circle one): 

Picture Parts not visible 

Sound Parts not audible 

Ambiguous Questions : 



Counter 

No. 

0-40 




Counter 

No. 

41-200 

































Poor Good 

Poor Good 
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GENERAL 

READ 

WORD 



PLACE 

NUMBER 
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■rtne -,5to, 200 



Tape No. 



cnever comes first) . 



counters or to the end 



St CONO SESSION (Be sure tn co+ + u 

to set the counter back to 0.) 




lape Quality, (circle one): 

Picture: p arts not Wsible 

Sound: Parts nQt audible 

Ambiguous Questions - 



Poor 

Poor 



Good 

Good 
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MINICOURSE FIVE 

CRITIQIJER TRAINING - DEMONSTRATION TECHNIQUES 



Behavio rs 

1. Estimation 

2. Expanded Notation 

3. Number Line 

4. Manipulative Materials 

5. Diagram or Picture 

6. Number Sentence 

7. Evaluation 

8. Practice 



General Comments: 

’• sections . Cr * t * c,uers * ffrst have read relevant Minicourse Five Handbook 

2. Calibrate VTR occasionally. Perhaps at the start of each day you can check 
the counters on your VTR for one minute. Anpex VTR, 20 counters - 1 minute. 



Scoring Rules 



1 . 



2 . 



4. 



to fo?l'L t n?r,^°w?rS e ^ Vl ? r ! y ? u w1 " V* U hel P fu > t0 u « the worksheets 
toJSl ? 9 K l th the tutoring session. Worksheets are to be found 

the f 1 rs t C and°second tu tor i ng slsltons^ f ° r 

Generally the teacher's mention of the behavior by name will cue vou to 

« s “ Ur "cT° ‘behavior. For example. -BF^imlte »Cr 

line will heir, " picture of the problem.- ’LePs see if a number 

rme win help. Here are some to do for practice ." 

the of each behavior and the amount of time 

ind P ractice wfnXi ^ U ? ters) U is used - The exHiplion Is EVALUATION 

strationtorh„Tn,? only thei »; ° ccurren< * . Sometimes the use of a demon- 
Thus vou m5is; que Can * top and itirt again within a tutoring session 

scoring°sheets) . SC ° re th * ^ ° f 3 diagram or p1cture way (see your 
DIAGRAM or* PICTURE 30-41, 79-82, 150-173. 

In scoring "DIAGRAM or PICTURE", score use of anv written visual aid fop 
example, one teacher wrote this problem involving Irixed fractions Jith a 
line and words separating the whole and fractional nmnbers 



Whole ] 


Part 


16 


1/3 


-13 


2/3 
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5 . 



6 . 



7. 



8 . 



!££? ? s an instanc e Of using a diagram or picture. If the teacher writes 
numbers or uses number tables (e.g. the “times" table), do not score it. 

For example, if the teacher developed understanding of fractions by usinq 
the aid, J 3 

1=2/2= 3/3 = 4/4 = 5/5 

do not score it. 

In scoring EVALUATION, score teacher statements that clearly indicate the 
student is to solve a problem on his own. For example, "Let's see if you 
can do this one without help," would be scored. But "Let's see if you can 
do this one, would not be scored. There Is an exception to this rule. 

If the teacher assigns the student a problem saying "Now do this one" (not 
scorable) and it is apparent that it is a problem assigned for the purpose 
of evaluation, score it. The rule to use here Is that the teacher should 
be quiet at least ten counters while the student works on the problem. 

as EVALUATION** StartS talking 0r ask1ng ^ uestions * n should not be scored 

NOTE. If the teacher praises the child during the first ten counters but 

^EVALUATION™ 1 ^ interfere With the cbild * th1s should st111 be scored 

Score PRACTICE when the teacher makes statements such as "Now do these at 
your desk or 'Here are some to do for practice." 

In determining amount of time that a technique is used, count the time the 
teacher takes in preparing to use the technique. For example, if the 
teacher says, Let's use some Cuisenalre rods now,* and then gets up to 
find them, this time would all be counted. 

Score only the first 200 counters of each tutoring session. 
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DEMONSTRATION TECHNIQUES 



Procedure: 



S “2 demonstration techniques for the first 200 counters, or 
to the end of the tutoring session (whichever comes first). 



Tape No. 



First Session 

Behavior Counter 

ESTIMATION 

EXPANDED NOTATION . 

NUMBER LINE 

MANIPULATIVE 

MATERIALS 

DIAGRAft/PICTURE 

NUMBER SENTENCE 

EVALUATION 

PRACTICE 



Total Counters 



(Circle one) 


NUMBER OPERATION 




VERBAL PROBLEM 


Worksheet: 


Yes 


No 






Picture: 


Good 


Fair 


Poor 


None 


Sound: 


Good 


Fair 


Poor 


None 
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tally occunwa or team* declarative statements. 

MjllliioLofj^eacte r statge nt: 

ing questions 'anTve rbal ^ra Ise) ch ( pra»! de^th d '! s J ostic questions, prompt- 
solvmg inforaatior wN i ch a teacher mi oK^ ‘Jf stu ^"‘ with problem- P 
■ a question rather than by telling him the answer by aski " 8 the student 

EXAMPLES OF DECLARATIVE STATFMFqyt; . 

Mary, 5 times 6 is 30 

When^you i°1t“ly 0 S. , Si fl , ,T n 2S e*" S a " d "W it. 

d ° k‘- You d <T’ ! qe°i l 200 W by °0? h ' nk < “ >0Ut place va,ue - 
Take our answer Mdw nlrtS t0 twentieths 

Yo " ® f* Z t0P ^ l”n n s« r w d co ad r e T a " d 1 f 

You can t take one ten from the thousands column 
Rules for Scoring ? 

tion phase. *** the entire tut °r1ng sequence with the exception of the evalua- 
te Ie f n^^ consecutively, tally each 

e - 9 * T; 15 “ 1S 

8/20 is 13/20. q 5/2 °* Five “twentieths plus 

Tally four declarative statements. 

declarative statement. 3 teacher s re P e *it1on of a student's answer as a 

®*9' $: Four tens. 

T: Forty. 

Do not tally as a declarative statement. 

ing or * problem's olvi^g t as declare tiw^statements^ ^ releV3nt t0 actual tutor " 

mislakls?' 5 l0 ° k a * thCSe Pr0b,ems a " d «« whore you mode your 

Do not t a 1 ly'as * declarative 7 statements? 0 “ nderstand how ** regroup. 

has misunderslood!°as de“!lra^Jf|^„£' Ch c,ar,fy d(rect,0 " s a student 
e *3* S: Add this one? 

DO not tany T ^s^ecl^a e ??ve h ;ta?e™ntr beri tMS 4?? a " d 776 ' 

the student which a the stSdm n obv-'ouslv , dSes b nn beaC,ler supp,,es fnformation to 

ments. Students often do rot possess ta£?Li2 * ?°l se “ as declar ati»e state- 

oo not possess knowledge of fundamental word definitions 



o 

ERIC 
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Declarative Statements Evaluation 



.-r.DiV 

<nov 



wn.it an altimeter is? 



ultiiPi.'i.or is 



which teachers • 
e.g. T: uo yes 

S: No. 

T: An 

obvT^sivVa^nn l3st o s J atem0l ^ t as a declarative sentence, since the student 
obviously hao no contention ot an altimeter 

However , T: Mary, what is 5 x 6? 

S: J don't know. 

T: Five times 6 is 30. 

£tat T° nt ? s a ,^ cl ? rative statement, since the teacher could 

the ,s 5 x 1? • How much is 5 x 2?", etc. and arrived at 

the information in this manner. 



DO NOT SCORE DECLARATIVE STATEMENTS WITHOUT FIRST READING THE INSTRUCTIONS 
FOR SCORING THE EVALUATION PHASE OF THE TUTORING SEQUENCE ** INSTRUCTI0NS 
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VERBAL PRAISE 
SPECIFIC VERBAL PRAISE 
DECLARATIVE STATEMENTS 
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PROOTURI: Score Verbal Praise, Specific Verbal Praise, and Declarative 

ts for 200 counters or to tie end of the tutoring session (whichever 
comes first). 

TAPE NO. 

CONTENT (Circle one): NUMBER OPERATION VERBAL PROBLEM 



SESSION NO. 



Counter 


4 Type 












































Counter 



SPECIFIC VERBAL PRAISE 



-Type 




Counter 



DECLARATIVE STATEMENTS 



Counter 



AMBIGUOUS STATEMENTS 
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TALLY OCCURRENCES OF PROMPTING QUESTIONS. 



Definition of a Prompting Question : 

Any statements or questions (other than Diagnostic Questions) which ask a 
student to do or say something or tell, a student to do or say something 
are prompting questions (e.g., "How much is six times five?"). Prompting 
questions do not include requests for the student to explain a concept or 
justify an operation. The purpose of a prompting question is to get the 
student, rather than the teacher, to perform an operation. 

EXAMPLES OF PROMPTING QUESTIONS 

Would you count the number of inches in one foot, please? 

You're adding how many to 6? 

Draw a picture of Mr. Green's field. 

What would be the first equivalent? 

How many 24ths would be the equivalent of 3/8? 

Will that reduce? 

Would you reduct that to lowest terms? 

How many tens do you have now? 

If we take one-thousand, how many hundreds can we make it into? 
Subtract 5 from 12. 

Write them down and then add them up for me. 

Could you write this as a number sentence? 

How much were they going to sell each ticket for? 



Rules for Scoring : 

1. Score the entire tutoring sequence with the exception of the 
evaluation phase. 

2. If two or more prompting questions are asked consecutively, tally 
only the question to which the student responds. 

e.g. T: Would you reduce 3/4? What is the lowest common denominator? 
How many eighths are there in 24? 

S: Three. 

Tally "How many eighths are there in 24?" as a prompting question. Ignore 
the other questions. 

3. If diagnostic and prompting questions are asked consecutively, 
tally only the question to which the student responds. 

e.g. T: Do you know how to reduce fractions to lowest terms? How 

many eighths are there In 3/24? 

S: One. 

Tally one prompting question. 

T: Do you know how to reduce fractions to lowest terms? How 

many eighths are there In 3/24? 

S: No, I don't. 

Tally one diagnostic question. 



** DO NOT SCORE PROMPTING QUESTIONS WITHOUT FIRST READING THE INSTRUCTIONS 
Q ' F0R DIAGN0STIC QUESTIONS AND THE INSTRUCTIONS FOR SCORING THE EVALUATION 

ERJC ; PHASE OF THE TUTORING SEQUENCE** 

- - 1 - - - ■ - - 
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TALLY OCCURRENCES OF STUDENT VERBAL RESPONSES. 



Definition of Student Verbal Respond 

pr i des eil^rtKc 1 nume?kal P Snsw; S° rt re ?f onses 1n which the student 
to so,uti °" 

e *9* o: jo feet. 

S: 44 miles and 500 feet. 

S: 3/4. 

3SS Sh0rt resp0nses ( '* 4 w « ds ) f ■ previous 

e.g. T: What did you do in this example? 

S: I added here. 



T: 

S: 



Can you work this multiplication? 
I think so. 



T: Now what should we do? 
S: Multiply 6 times 5. 



c 0 ^ ^ you subtract your tens the way they are now? 

S: Because you can't take away eight from two 



T: 

S: 



Alright, so now what are you going to do? 

Take one hundred from the hundred's column and regroup. 



feLs^y^nirU n teacher «< 

e * 9 ’ li Sf?i y0 r te ]l 4 W ?/ 5 w you worked this problem? 

- „ nine ’times four' is tineS " Ve iS 45 ' aa< 

Tally as one long student response. 



T: 

S: 



Would you read the problem for me? 

A fifth-grade class put on a play In order to raise money for 

^did they^make? 285 t1ClletS “ 94 a t1cket - How much 
Tally as one long student response. 



Rules for Scoring ; 



the evaluation phYTl.Ytufo^g J^***"* 1 " ° f those *■« duri, 





ocuuent Verbal Responses Evaluation 
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S: 



2 : 



any time inter?!? betweJ two^Cnseiutl v^le^he^s t^^nL 3 StUde " t n,akes duri " 9 
e *9> Tj. We ve only got 100 feet. statements. 

t!k!X y ??f? a o?e^^rdi?ide a th™ ny m^I dS th 1n ]°2 as you can and 

W??l ,00 h yd H dS , intO feet and wt| at is left over ,nt ° ***' V ° U Cha " ge 
off thf !u^r of 0 ?a??? r ?„V?!?!? 3 3 PlCtUre ° f 10 feet and maI “king 

All student utterances between Y, and T, ccmstitute a single student response. 

scored as student b verbal responses^ answers stated ,n question form should be 
e, 9* What is your answer? 

S: Is it 36? 



T: Six times eight. 
S: 48? 
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TALLY EACH OCL'JfflENCE OF VERBAL PRAISE. TALLY THE NUMBER OF TYPES OF VERBAL PRAISE USEO. 



Definition of Verbal Praise : 

Verbal praise consists of. verbally rewarding a student who has given the desired or 
the correct response. "Good," "Fine," "That's right," "Correct" are examples of 
verbal praise. 



Rules for Scorin g: 

1. Score the entire tutoring sequence. 

2. Do not score ambiguous or vague words and phrases such as "Alright," "Okay," 
"Uh huh," "Uni hmm". 

3. Do not score repetitions of the student's answer as Instances of verbal praise. 

4. When two or more words of verbal praise occur together without the student 
having an opportunity to respond in between, tally only the first word as 
verbal praise. 

e.g. T: That's right. Good. Exactly. 

Tally "That's right" as an instance of verbal praise. Ignore "good" and 
exactly." 

5. When two instances of verbal praise contain at least one praise word In common, 
tally both of them In the same verbal praise category. 

e.g. a) That's exactly right. 

Exactly. • same type of verbal praise. 

Right. 



b) That's right. 
That's good. 



two different types of verbal 
praise. 



Examples of Verbal Praise : 

Number operations sequence 
Verbal praise 
Exactly right* 

Exactly 
Right 

That's right 
That's good 






score as one typ< 



Frequency 

3 

4 

3 

2 

1 



Total f3 

Total types 2 



Verbal reasoning 


sequence 


Frequency 


verbal praise 
That's correct 




1 


Exactly right! 


score as one type 


3 


Exactly j 


1 




Total 


5 




Total types 


2 




1)5 
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verbal Praise Evaluation 



6 . 



Examples of vague or ambiguous statements that wnuiH „ . 

stances of verbal praise. 1 would not be scored as in- 

a) S: Two feet 9 inches. 

nn ' Fwo feet ? inches - Now, how about ... 

Do_not score repeating student's answer as verbal praise. 

t>) S: The answer is 1497. 

Do not^core^lHaKS l et ' S !°°* at the second P^blem. 

— not ->core alright as an Instance of verbal praise. 

c) T: Okay, 10 feet 10 Inches. 

Dojiot score "okay” as an Instance of verbal praise. 

d) S: Sixteen. 

T: Urn hm. And next? 

Do_not score "urn hm" as an Instance of verbal praise. 



aticn? 6 "* 5 “ h1Ch are SC ° red as vert,al P ra1se de P«“H"9 on the teacher's Inton- 
e.g. S: Ten. 

T: It would take ten, exactly. 

woul^tak^exactlv ten“? er jl 1* r clear - D “ s »l» mean “It 

sas-S Ss! - an 

UKfh. lf shd means » ” lt would take ten. Exactly!", then "exactlv" 
should be scored as an instance of veroal praise. The rater c£™f7 

Isten to the Intonation of the teacher's voice carefullv in an in 



**D0 NOT SCORE VERBAL PRAISE WITHOUT FIRST READING THE EVALUATION INSTRUCTIONS 

FOR SPECIFIC VERBAL PRAISE.** 



117 



TALLY EACH INSTANCE OF SPECIFIC VERBAL PRAISE. 



Definition of Specific Verbal Praise: 

ver bal praise is a conmendation which is linked closely to a spe- 
cific aspect of the student's problem-solving or computational behavior 
which has been performed correctly. A statement should be scored as spe- 
cific verbal praise only if it mentions the specific operation or computa- 
tion which the student has performed correctly. 

e.g. "I think you know how to multiply fractions now. 11 
"You have regrouped correctly." 

Rules for Scori ng: 

1. Score the entire tutoring sequence. 

2. In instances where specific verbal praise Is either preceded or followed 
by one or more phrases of verbal praise, score only We~spec1fic verbal 
praise. 

e.g. "Good. Fine. Your multiplication is correct." 

"Your mulitplication Is correct. Good. Fine." 

Tally "Your multiplication Is correct" as an Instance of specific verbal 
praise. Ignore "good" and "fine". 

3. Where two or more statements of specific verbal praise occur together, 
tally the statements as separate Instances of specific verbal praise if 
they each praise distinctly different operations or computations which 
the student has performed correctly. 

e.g. a) "You did the correct step here when you added the lengths of 
the two airplanes, and you got the right length, the sum of 
the two lengths." 

b) "And you are subtracting the length of the football field." 

c) "Your arithmetic is correct In that you are subtracting." 

Tally statement A as one instance of specific verbal praise, since it 
refers to the student's correct addition. Then tally statements (b) and 
(c) as one more instance of specific verbal praise since both of them 
refer to a single arithmetic process that the student has performed 
correctly. 

EXAMPLES OF SPECIFIC VERBAL PRAISE 
Number operations sequence : 

Specific verbal praise Frequency 

"You got all of these common 
denominators right." ] 

Total 1 
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ipecitic Verbal Praise Evaluation 



Ver bal r easo ning sequence 
Specific verbal prais e 



That s right. You know that when 
you take one foot from 150 feet you 
have 147 feet left." 



you are correct in multiplying the 
length °f 40 feet times the width of 
60 feet m order to find the area." 



Ana here you have added correctly 
the area of the smaller rectangle t 
the area of the larger rectangle." 



"Your arithmetic is correct in that 
you have added." 



! 

✓ 



Score as 
one type 



frequency 



1 



1 



1 



Total 3 



verbal e praise? bl9U ° US statements that w °u1d not be scored as specific 
"You're doing that exactly right." 

Do not ?^?° tice - that th1s one is correct." 

ticu?!r o^a?]on n ?J? n ^?ch f the e siIdL ] e !' ba1 s,nce P»>- 

the teacher Taiiu LfE* * student Praised was not specified bv 
specific verbal 3 pra1se^ SUtBnents « of verbal pfalsel Sot 



**00 NOT SCORE S ^C.HC J^At^^SE^W^THO^ORST READING THE EVALUATION 



o 

ERIC 

y> j .iriiZiMi?LiJ 
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Teacher 



MINICOURSE FIVE 
QUALITATIVE EVALUATION 
Tape# 



Total Score 



Rater 



Pre 



Post 



'' ( J d e? h So^|S^ r w :| e i:J s La«on?) dent ’ s ** ^ 

1. Failed to identify the student's problem 



3. Satisfactory identification of the student's problem 

4 . 

5. Did a really good job of pinpointing the student's problem 



1. Concepts and procedures poorly explained 



: 3. Concepts and procedures satisfactorily explained 



4. 



5. Concepts and procedures very weli explained 



3. How well did the child seem to understand the teacher's explanation? 
— 1. Poor understanding 



2 . 



— 3 ‘ Some und erstand1ng (better than when he came in) 

4. 



S. Good understanding 



O 

ERIC 
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TOTAL NO. PRAISE _ 

TOTAL TYPES PRAISE • 

Procedure: Score Verbal Praise and specific Verbal Praise for 150 Counters 

or to the end of the tutoring session (whichever comes first). 

Teacher Tape No. Pre Post 

Session No. Countent (Circle One): NUMBER OPERATION 



VERBAL PF.OBLEM 

VERBAL PRAISE 



COUNTER TYPE COUNTER TYPE ! 


j 








1 i 

i 
















j 








i 

i 

i 








i 

i 








j 

i 











































SPECIFIC VERBAL PRAISE 



TYPE 



i 

i 

I 



O 

ERIC 



T3d 



COUNTER 



mm: 



TYPE 



Appendix F 



Scoring Sheets for Videotaped > 
Samples of Tutoring Behavior 



I 

j 



i 



'i 

i 



\ 



1 



\ 
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Teacher Tape J X QR Scorer 

PROMPTING STUDENT RESPONSE GENERAL VERBAL PRAISE SPECIFIC VERBAL PRAISE 
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13 



O 

rw 






***** 



7 






T-T 
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I 

i 

i 
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Appendix G 



Administration Instructions for 
The Content Referenced Test 
and the Wide Range Achievement Test 
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ADMINISTRATION 



126 



Examiner’s (E) material: A test copy and a stop watch. 



I WANT TO SEE HOW WELL YOU CAN ANSWER THESE QUESTIONS. WRITE ALL 
OF YOUR ANSWERS ON THE PAPER. DO NOT SAY THE ANSWER OUT LOUD. 

DO NOT TALK WHILE YOU ARE ANSWERING THE QUESTIONS. FIRST, WRITE 
YOUR NAME, FIRST NAME AND LAST NAME, ON TOP OF THE PAPER. WHEN 
YOU HAVE FINISHED, DO NOT START THE QUESTIONS, WAIT AND WE WILL ALL 
START TOGETHER. I WILL READ THIS PART WITH YOU SO, DO THE QUESTIONS 
ALONG WITH ME. DO NOT TURN THE PAGE UNTIL I TELL YOU. 

E distributes part I tests. 

DOES EVERYONE HAVE THEIR NAME ON THE PAPER? 

LOOK AT THE FIRST PAGE - IT HAS ROWS OF NUMBERS. 

I’M LOOKING FOR A FIVE - HERE IS A FIVE (point to the 5) WATCH ME DRAW 
A CIRCLE AROUND THE 5. 

LOOK AT THE NEXT ROW (point to the next row). 

FIND THE TWO IN THIS ROW - DRAW A CIRCLE AROUND IT 

(10 second pause) 

LOOK AT THE NEXT ROW (point to the next row) 

FIND THE SEVEN I N THIS ROW - DRAW A CIRCLE AROUND IT 

(10 second pause) 



LOOK AT THE NEXT ROW (point to the next row). 

FIND THE THREE IN THIS ROW - DRAW A CIRCLE AROUND IT 

(10 second pause) 



LOOK AT THE NEXT ROW (point to the next row). 

FIND THE EIGHT IN THIS ROW - DRAW A CIRCLE AROUND IT. 

(10 second pause) 



TURN TO THE NEXT PAGE. 
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ON THIS SIDE OF THE PAGE YOU CAN SEE DRAWINGS OF DIAMONDS, BALLS, 
CANDY CANES AND OTHER THINGS: ON THE OTHER SIDE, THERE ARE SOME 
NUMBERS. LETS COUNT THE DIAMONDS. 

E displays her test copy and point to each item as she counts out loud. 

ONE, TWO, THREE, FOUR, FIVE, SIX. THERE ARE SIX DIAMONDS HERE SO 
I WILL DRAW A LINE TO THE SIX. 



NOW YOU COUNT THE REST OF THE THINGS ON THIS PAGE AND DRAW LINES 
TO THE CORRECT NUMBERS. 

(60 second pause) 

NOW TURN TO THE NEXT PAGE. LETS COUNT THE BALLS AT THE TOP OF THE 
PAGE. 



E point to each item as she counts out loud. 



ONE, TWO THREE. THERE ARE THREE BALLS HERE SO I WILL WRITE THE 
NUMBER THREE ON THE ANSWER LINE. NOW YOU COUNT THE THINGS ON 
THE REST OF THE PAGE AND WRITE YOUR ANSWERS ON THE ANSWER LINES. 

(90 second pause) 

NOW LOOK AT THE PROBLEM AT THE BOTTOM OF THIS PAGE. YOU ARE TO 
ADD A QUARTER, A NICKEL AND A DIME. WRITE YOUR ANSWER ON THE 
ANSWER LINE. 



(15 second pause) 

TURN TO THE NEXT PAGE THIS IS THE FACE OF A CLOCK. IT DOES NOT 
HAVE ANY NUMBERS ON IT. PUT THE NUMBERS ON THIS CLOCK. 

(60 second pause) 

FOR THE NEXT PROBLEM, WHICH NUMBER IS MORE, 9 OR 5 ? WRITE THE 
ANSWER ON THE ANSWER LINE. 



WHICH NUMBER IS MORE, 6 OR 8? 



(10 second pause) 



(10 second pause) 



WHICH NUMBER IS MORE, 43 OR 27? 
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(10 second pause) 



NOW, WHICH NUMBER IS LESS, 7 OR 4 ? 



(10 second pause) 
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WHICH NUMBER IS LESS, 34 OR 18 ? 



(10 second pause) 

FOR THE NEXT PART, YOU ARE TO WRITE THE CORRECT NUMBER TO FIT 
THE NUMBER NAMES. FOR EXAMPLE, LOOK HERE (E point to demonstration 
item). SEE THE WORD FIVE? THE NUMBER 5 IS WRITTEN IN THE ANSWER 
NOW YOU DO THE REST BY YOURSELVES. 



(30 second pause) 

NOW TURN THE PAGE. THREE PENNIES TAKE AWAY ONE PENNY EQUAL. 
WRITE THE ANSWER ON THE ANSWER LINE. 



(10 second pause) 

FOUR PENNIES AND TWO PENNIES EQUALS. 



(10 second pause) 

NOW WHAT TIME DOES THIS CLOCK SAY (E points to first clock on page) ? 
WRITE YOUR ANSWER ON THE ANSWER LINE. 

(15 second pause) 

WHAT TIME DOES THIS CLOCK SAY ? (E points to clock on bottom of page) ? 

(15 second pause) 

NOW TURN THE PAGE. WHAT TIMES DO THESE CLOCKS SAY? 

(60 second pause) 

NOW PUT YOUR PENCILS DOWN AND PASS YOUR PAPERS TO THE 
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PART n 



I WILL DO THIS PART ALONG WITH YOU SO WHEN I HAND OUT YOUR PAPERS 
PUT YOUR NAME ON THE TOP OF THE PAGE AND WAIT. 

E distribures part II tests. 

THE LINES ON THIS PAGE ARE CALLED NUMBER LINES 

THIS NUMBER LINE MEANS THAT SK PLUS TWO EQUALS SEVEN (point to the 
arrowed lines on the number lines) THE ANSWER IS WRITTEN IN THIS BOX (poin 
to the answer box). 



WRITE THE ANSWERS FOR THESE NUMBER LINES (point to the next two number ! 
lines) j 

(30 second pause) 

NOW DRAW THIS PROBLEM ON THE NUMBER LINE 



(15 second pause) 

TURN THE PAGE 

WRITE THE ANSWERS TO THESE PROBLEMS IN THE BOXES. DO THESE BY 
YOURSELVES 



(5 minute pause) 



HERE ARE SOME WORD PROBLEMS. I WILL READ EACH PROBLEM ALONG 
WITH YOU AND THEN YOU WRITE THE ANSWER TO THE PROBLEM. 

(read the first problem) 



(read the second problem) 



(15 second pause) 



(read the third problem) 



(15 second pause) 
(15 second pause) 



NOW PUT YOUR PENCILS DOWN AND PASS YOUR PAPERS TO THE 



| 

i 



j 

i 
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PART m 



WHEN I GIVE YOU YOUR PAPERS. WRITE YOUR NAME ON THE TOP OF THE 
PAGE. DO THIS PART BY YOURSELVES. YOU HAVE 15 MINUTES. 

( 15 minutes pause) 



PUT YOUR PENCILS DOWN AND HAND YOUR PAPERS TO THE 
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PART IV 



WHEN I GIVE YOU YOUR PAPERS, WRITE YOUR NAME ON THE TOP OF THE 

PAGE. DO THIS PART BY YOURSELVES. YOU HAVE 10 MINUTES. j 

i 

i 

(10 minutes pause) I 

f 

I 

PUT YOUR PENCILS DOWN AND HAND YOUR PAPERS TO THE 



\ 

\ 

\ 

i 

j 

j 



j 

i 

$ 

s 

'] 

i 

j 

I 
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